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I.   THESIS  OBJECTIVES  AND  ORGANIZATION 

A.   FAULT  TOLERANT  COMPUTER  SYSTEMS 

In  modern  applications,  exceptionally  high  reliability 
levels  are  often  required  from  digital  computers.   Examples 
of  such  extremely  severe  requirements  can  be  found  in  deep 
space  missions  and  some  military  applications.   In  addition 
long  non-critical  jobs  often  require  concurrent  error 
detection.   To  achieve  those  high  reliability  levels  one  has 
available  three  basic  strategies,  two  of  which  are  also 
capable  of  providing  concurrent  error  detection  capability: 

1.  Use  of  highly  reliable  components  in  the  manufacture 
of  computers.  This  approach  leads  very  rapidly  to  astronomi 
cal  cost  increases. 

2.  Use  of  redundancy — equipment  redundancy  or  sub- 
systems redundancy.   In  this  scheme  fault  detection  is 
achieved  by  comparison  of  outputs,  and  error  correction 
through  some  majority  voting  criterion. 

3.  Use  of  more  sophisticated  redundancy  schemes,  such 
as  encoding  for  error  detection  and/or  correction. 

The  term  fault  tolerancy  applies  to  those  redundancy 
schemes  designed  to  provide  reliable  operation  in  systems 
constructed  with  relatively  unreliable  components.   The  most 
widely  accepted  concept  for  fault  tolerant  computing  system 
implies  the  existence  of  a  built-in  capability  to  preserve 
the  continued  correct  execution  of  programs  and  input-output 


functions  even  in  the  presence  of  a  certain  set  of  operational 
faults.   For  our  purposes  an  operational  fault  is  a  change  of 
the  value  of  one  or  more  logical  variables  occurring  as  a  con- 
sequence of  a  failure  in  the  system's  hardware. 

The  systematic  study  of  fault  tolerant  systems  was  initi- 
ated in  the  early  sixties,  and  has  as  one  of  its  milestones 
the  publication  by  William  Pierce  of  his  book,  Failure  Tolerant 
Computer  Design.   In  this  work,  inspired  by  the  results  of 
Information  Theory  and  Coding  Theory,  he  attempted  to  apply 
the  idea  of  redundancy  to  achieve  high  reliability  in  computer 
hardware . 

The  field  of  fault  tolerance  has  grown  significantly  since  and 
unifies  various  approaches  to  reliability  assurance  by  means 
of  testing,  diagnosis  and  redundancy  in  machine  organization 
and  operation.   It  emerged  in  the  late  1960's  and  reached 
maturity  with  the  formation  of  the  IEEE  Computer  Society 
Technical  Committee  on  Fault-Tolerant  Computing  in  1969  and 
the  subsequent  holding  of  the  First  International  Symposium 
on  Fault-Tolerant  Computing  in  1971.  This  Symposium  that  has 
been  held  annually  since,  has  became  the  major  international 
forum  for  the  discussion  of  current  experience  and  new  ideas 
in  system  design,  redundancy  techniques,  system  modeling  and 
analysis,  testing  and  diagnosis  methods,  and  other  related 
areas . 

B.   FORMULATION  OF  THE  THESIS  OBJECTIVE 

The  objective  of  this  thesis  is  to  study  the  theoretical 
fundamentals  behind  the  fault  tolerant  design  of  arithmetic 
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units.   More  specifically  this  study  will  be  concerned  with 
the  so-called  arithmetic  error  correcting  codes. 

Parity  check  error  correcting  codes  have  been  extensively 
used  in  communications  to  ensure  reliability  in  communica- 
tions flowing  through  noisy  channels.   In  a  similar  manner 
those  codes  are  suitable  for  use  in  computer  systems  whenever 
transmission  of  information  takes  place  between  different  sub- 
units,  to  prevent  error  caused  by  failures  in  the  circuitry 
involved.   In  addition,  they  may  be  used  to  provide  the 
desired  degree  of  fault  tolerancy  to  memories  of  different 
types.   Similarly,  error  correcting  codes  can  be  designed  that 
will  be  conserved  through  arithmetic  operations.   An  arithmetic 
code  is  a  code  such  that,  given  a  set  of  arithmetic  operations, 
the  result  of  those  operations  performed  on  operands  represented 
in  encoded  form  is  the  encoded  result  of  the  operation  if 
performed  in  the  original  operands . 

One  should  notice  that  in  studying  fault  tolerance  as 
achieved  by  the  use  of  error  correcting  codes  we  often  assume 
implicitly  perfect,  error  free,  decoding.   It  is  interesting 
to  comment  that  this  assumption  is,  in  the  context  of  fault 
tolerant  computer  systems,  stronger  than  when  concerning 
error  correcting  codes  in  communications.   In  fact,  the 
checking  circuitry  in  fault  tolerant  computers  is  essentially 
the  same  kind  of  hardware  used  in  the  units  to  be  checked, 
while  in  communications  one  can  easily  justify  the  belief 
that  the  decoder  hardware  is  much  more  reliable  than  the 
noisy  channel. 
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Even  recognizing  this  fact  we  will,  through  all  discussion 
in  this  thesis,  assume  perfect  decoding,  unless  otherwise 
specified,  since  our  main  objective  is  to  study  the  structure 
of  the  codes,  as  opposed  to  the  evaluation  of  the  resulting 
reliability  improvement  obtained  when  those  codes  are  used 
in  fault  tolerant  computers. 

C.   ORGANIZATION  OF  THE  THESIS 

The  theory  of  the  parity  check  error  correcting  codes  used 

in  communications  has  as  one  of  its  basic  ideas  the  concept  of 

distance  between  two  code  words.   In  very  simple  terms  the 

distance  between  two  code  words,  or  in  general,  between  two 

n-tuples  an_1,  an_2,  ...,  &±    ...a^  and  bn_1,  bn_2,  .  .  .b± 

...b.b„  is  the  number  of  positions  such  that  a-  f   b- .   If  a 
10  r  11 

code  word  w  is  transmitted  and  w   is  received,  we  say  that 

e  ' 

k  errors  have  occurred  if  the  distance  between  w  and  w  , 

e ' 

d(w,we)  =  k     k  =  0,  1,  2,  .. .n-1. 

As  mentioned  before,  the  objective  of  our  study- -arithmetic 
codes--  is  codes  that  are  preserved  throughout  a  set  of 
arithmetic  operations,  in  particular  addition,  since  this 
is  the  basic  operation  performed  by  computer  arithmetic  units. 

It  should  be  clear  that  the  definition  of  distance  and 
the  resulting  classification  of  errors  as  described  above 
are  not  adequate  as  the  basis  for  a  theory  in  arithmetic 
codes.   In  effect,  even  if  the  adder  cell  is  designed  in 
such  a  way  that  a  single  hardware  failure  affects  only  one  of 
the  results  or  the  carry  bit,  a  single  failure  may  result  in 
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the  modification  of  the  value  of  many  code  elements  at  the 
adder  output,  due  to  the  propagation  of  the  carry.   A 
different  concept  of  distance  suitable  for  use  in  the  theory 
of  arithmetic  codes  is  presented  and  developed  in  Chapter  II. 

We  will  discuss  in  this  work  two  general  classes  of 
arithmetic  codes:   AN  codes  and  separate  codes.   AN  codes, 
that  are  discussed  in  Chapters  III  and  IV,  feature  some  in- 
convenient attributes  as  far  as  practical  implementation  is 
concerned.   One  such  inconvenience  is  that  the  original 
information  elements  are  not  preserved  in  the  encoded  form. 
In  addition,  medium  distance  codes  with  large  numbers  of 
code  words  have  not  been  found.   Nevertheless,  they  are  very 
important  in  many  respects,  particularly  from  a  theoretical 
point  of  view.   Some  important  classes  of  AN  codes  are  in 
some  respect  analogous  to  some  classes  of  algebraic  codes . 
The  basic  theory  of  AN  codes  is  studied  in  Chapter  IV.   In 
Chapter  V  a  special  class  of  codes  analog  to  the  cyclic 
algebraic  codes  is  introduced  and  discussed. 

Separate  codes  are  those  which  preserve  in  the  encoded 
form  the  original  representation  of  the  encoded  information, 
concatenated  with  a  set  of  check  symbols.   Those  codes  which 
are  more  attractive  to  practical  implementation  are  introduced 
and  discussed  in  Chapter  V, where  their  relation  with  associated 
AN  codes  with  the  same  error  correcting  and  detecting  capa- 
bility is  explored.   Even  though  this  thesis  is  mostly 
concerned  with  the  theory  of  arithmetic  codes,  a  brief  dis- 
cussion on  implementation  is  carried  out  in  Chapter  VI. 
Finally,  some  conclusive  comments  as  well  as  some  topics  open 
for  future  research  are  briefly  presented  in  Chapter  VII. 
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II.   ARITHMETIC  DISTANCE 

A.   ERRORS  IN  BINARY  ADDITION 

It  is  very  important  in  the  design  of  any  error 
correcting  code  to  take  as  a  preliminary  step  the  identifi- 
cation of  the  most  likely  modes  of  failure  in  the  coded 
system. 

This  identification  will  provide  the  starting  point  for 
the  formulation  of  a  convenient  description  of  the  error  that 
can  be  present  at  the  system's  output. 

In  this  section  three  questions  will  be  examined  in 
detail  for  a  binary  adder,  a  unit  which  performs  addition 
on  two  integers  represented  as  binary  numbers .   At  this 
particular  point  we  will  not  impose  any  restrictions  on 
those  integers  other  than  the  requirement  of  being  non- 
negative.   The  adder,  in  this  fashion,  may  be  a  potentially 
infinite  device,  since  no  limitation  has  been  imposed  with 
respect  to  the  size  of  the  operands. 

The   radix-2  form  of  an  integer  I  is  the  expression 

I  =  a   +  a-,.  21  +  a,,.  22  +  a-,21  +  ... 

o     1         2  1 

ai    e    (0,1)  (2.1) 

When  a^  =  0  for  all  i  >_  n  and  a   ,  f   0 ,  we  usually  write  the 
radix-2  form  as  the  n-tuple 

an-l'  an-2'  ' • '  ai  * ' '  al»  a0 
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1  * 


(a)   block  diagram 
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(c) 

Full  Adder 
cause  C 


truth  table 


Single  component  failure  will  not 
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and  we  say  that  n  places  are  required  to  represent  I  in 
radix- 2  form. 

The  adder  circuitry  can  be  thought  of  as  a  sequence  of 
elemental  building  blocks--full  adders  in  integrated  circuit 
terminology- -that  are  associated  with  each  binary  position 
or  power  of  2.   The  elemental  adder  has  as  inputs  the  co- 
efficients of  the  two  operands,  corresponding  to  a  given 
position  in  their  radix-2  forms  and  the  carry  propagating 
from  the  previous  position.   It  generates  at  its  output  the 
respective  coefficient  of  the  radix-2  form  of  the  result  and 
the  carry  to  the  next  binary  position.   An  adder  cell  is 
represented  in  Figure  2.1. 

For  the  situation  illustrated  in  Figure  2.1  it  seems 
natural  to  consider  that  a  single  error  has  occurred 
whenever  an  incorrect  sum  r-  or  an  incorrect  carry  c-  is 
generated.   In  consequence  of  this  concept  a  single  error 
in  the  adder  output  will  correspond  to  the  addition  of  +  2^ 
to  the  correct  result  of  its  operation. 

Suppose  now  that  the  actual  result  produced  by  a  binary 
adder  differs  by  E  from  the  correct  result.   E  can  be 
represented  as 

E  =  £  _ei2i  e±e  f-1,  0,  +l]  (2.2) 

i=0         L         j 

It  is  then  natural  to  consider  that  the  number  of  errors 

occurred- -  the  arithmetic  weight  of  E--as  being  the' mini mum 

number  of  e-  for  which  e-  $    0  in  an  expression  such  as  (2.2) 
For  example,  E  =  7 
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7=lx22+lx2+lX2°=lx23-lx2° 
w(7)    =    2 


B.   ARITHMETIC  WEIGHT 

To  formalize  the  concept  introduced  in  the  previous 
section,  let  us  consider  an  error  E,  which  may  be  positive, 
negative  or  zero.   We  can  express  E  as 


E  =  e 


+en   2   +  e,   e"  +  . . .  e • 21  + 
o    1        2  l 


ej_  £  {-1,  0,  1}  (2.3) 

Such  an  expression  is  called  a  modified  binary  form  for  E, 

and  in  general  is  not  unique  as  illustrated  in  the  example 

in  Section  II. A.   It  can  be  easily  seen  from  (2.5)  that  if 

21  divides  E  then  e   =  e .  =  «s  •  ,  =  0 . 

o     1     l-l 

Definition  2.1 

The  arithmetic  weight  of  the  integer  E,  denoted  W(E), 
is  the  least  number  of  nonzero  coefficients  in  a  modified 
binary  form  for  E.   Besides  the  fact  that  an  expression  of 
the  form  given  in  (2.3)  is  not  unique  in  general,  it  is 
possible  that  more  than  one  of  those  expressions  have  the 
minimum  number  of  nonzero  terms. 

For    example,    3    =    lx2x    +    lx2      =1x2"*-    1x2 

and  thus,  the  weight  of  5  is  2,  but  there  are  two  different 
expressions  that  achieve  the  minimum  of  two  nonzero  terms. 
There  is,  however,  a  canonical  form  for  every  number  which 
has  the  minimum  number  of  terms.   This  form,  introduced  by 
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Reitwiesner,  is  unique  and  has  proved  of  much  importance  in 
the  theory  of  arithmetic  coding.   It  is  called  the  non- 
adjacent  form  (or  NAF  for  short)  if  the  coefficients  e- 
satisfy  e-e.+1  =  0  for  i  =  0,  1,  2,  ...,  in  other  words,  if 
there  are  no  two  adjacent  nonzero  coefficients  in  its  ex- 
pression. 

Theorem  2 . 1 

For  every  number  N  there  is  a  unique  representation 
of  the  form 

E  =  e   ,2     +  . . .  +  en 
n-1  0 

J). 

in  which  e.  =  +1  or  0,  and  in  which  no  two  successive  e.  are 
l    —      '  l 

both  nonzero.   This  representation  has  the  minimum  number  of 
nonzero  terms . 

Proof 

First,  the  existence  of  a  representation  of  this 
type  with  a  minimum  number  of  nonzero  terms  will  be  demon- 
strated, and  then  the  uniqueness  will  be  demonstrated.   Let 

E  =  en.1  211"1  ♦  ...  ♦  eQ  (2.4) 

If  there  exists  two  successive  nonzero  e.,  then  let  the  pair 

with  the  smallest  i  be  e .  , ,  21    +  e-  21.   If  e.  =  -e-  -,, 

l+l         1  l      i+l' 

then  e .  .  2     +  e.  2   =  e.+,  2   and  the  resulting  expression 
has  fewer  ones.   If  e-  =  e-+,,  then 
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oi  +  l      ~>i  _  «     0i  +  2    a   ~i 
ei+1  2    +  e.  2   =  ei+1  2    -  e±   2  . 


If  this  substitution  is  made  in  Equation  2.4,  the  coefficient 

of  21+  will  become  zero.   The  term  e-+i  21    can  be  combined 

with  the  existing  term  e-+2  2    .   If  e.  2  is  zero,  the  new 

expression  has  the  same  number  of  terms  as  the  old.   If 

e.L-,  =  -e-,_T,    these  terms  cancel  and  there  are  fewer  terms. 
i+2     i+l' 

If  e . +2  =  e-+,,then  combined  they  become 

0i  +  2        ->i  +  2        -,i  +  3 

e .  ~    2    +  e .  ,  2    =  e .  ,  2 
i+2         i+l         i+l 

and  the  coefficient  of  2   "  becomes  zero,  while  the  e-+,  2 
must  be  combined  with  the  term  e.+-  21  J.   The  "carry"  may 
propagate  to  the  highest-order  term,  but  each  time  a  carry 
occurs,  the  number  of  nonzero  terms  decreases.   Thus,  the 
resulting  expression  has  the  same  general  form  given  by 
Equation  2.4,  and  has  no  more  nonzero  terms  than  the  original 
expression,  and  has  no  two  successive  nonzero  terms  of  degree 
less  than  i+2. 

If  this  process  is  repeated,  an  expression  will  result 
that  has  no  two  successive  nonzero  terms,  and  no  more  nonzero 
terms  than  the  original  expression.   The  process  will  certainly 
terminate  because  each  step  leaves  at  least  two  more  terms  in 
the  low-order  part  which  has  no  pair  of  successive  nonzero 
terms,  and  there  is  at  each  step  no  more  terms  in  all  than  the 
initial  number,  which  was  certainly  finite. 

If  the  original  expression  used  had  a  minimum  number 
of  terms,  the  number  of  terms  can  decrease  no  more,  and  so 
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the  final  expression  must  have  exactly  the  same  number  of 
terms.   Since  every  number  certainly  has  an  expression  of 
the  form  in  Equation  2.3  with  a  minimum  number  of  terms,  it 
follows  that  every  number  has  an  expression  of  that  same 
type  with  a  minimum  number  of  terms  and  no  two  successive 
nonzero  terms . 

It  remains  to  be  shown  that  the  expression  is  unique. 
First,  note  that  in  an  expression  of  the  type  in  Equation  2.3 
with  all  coefficients  +1  or  0,  if  the  leading  coefficient  is 
+1,  then  the  smallest  value  of  E  could  occur  if  all  other 
coefficients  are  -1,  and  in  that  case 

E     =  2n_1  -  2n"2  -  ...  -1  =  1 
mm 

Similarly,  if  the  leading  coefficient  is  -1,  the  largest 
value  E  could  have  would  be  -1.   Thus,  an  expression  can  be 
zero  if  and  only  if  all  coefficients  are  zero. 
Now  define 


El  =  an-l  +  ...  +  a0 


E2  =Vl  2""1  ♦  ...  ♦  bQ 


and  suppose  that  no  two  successive  coefficients  in  either 
expression  are  nonzero,  and  that  for  at  least  one  i,  a-  f   b-  . 
Then 

E2  "  El  "    <\-l    -    an-l)  2n_1  +  fbn-2  "  an-2)  2""2 
♦  ...  *    (b„  -  aQ). 
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Then,  if  a-  f   b.,  there  are  two  cases;   either  a-  =  -b.  or 
one  of  them  is  zero.   In  the  latter  case,  the  expression  for 
E2  -  E-.  has  a  nonzero  term  (b-  -  a.)  2  ,  since  a  carry  from 
the  (i-l)th  position  is  impossible.   In  the  former  case  the 
term  2b.  21  =  b.  21    results.   But  since  neither  the 
expression  for  E,  or  for  E2  has  a  pair  of  successive  nonzero 
terms,  b-  -,  =  a-+,  =0,  the  term  b-  2    remains  in  the  ex- 
pression for  E?  -  E-,  .   If  all  pairs  of  terms  a-  2   and  b.  2 
are  combined  in  this  manner,  the  resulting  expression  has 
the  form  in  Equation  2.3.   Not  all  coefficients  are  0,  and 
therefore,  E-,  -  E?  f-    0,  so  that  two  distinct  expressions  give 
unequal  numbers . 

This  proof  shows  how  to  express  any  number  in  the 
canonical  form  and  thus  determine  the  arithmetic  weight.   As 
an  example,  let  us  take  431  or,  in  binary  notation 
110101111. 

451    =  28    +    27    +    0    +    25    +    0    +    23    +    22    +    2    +    1 

28    +    27    +    0    +    25    +    24    +0+0+0-1 
28+27+26+0-24    +0+0+0-1 
=    29    +0+0-    26    +    0    -    24    +0+0+0-1 

and  the  arithmetic  weight  is  4,  since  there  are  4  nonzero 
terms  in  the  final  expression. 

The  arithmetic  weights  of  the  first  few  numbers  is 
as  follows: 

1    2    3    4    5    6    7    8    9    10    11    12    13    14    15    16    17 
1121222122      3      2      3      2      2      1      2 
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18    19    20    21    22    23    24    25    26    27    28    29    30    31    32 
232333233323221 

The  following  pattern  was  first  observed  by  Chiang  and  Reed 
(1970) .   Starting  from  any  number  2   +  1  up  to  2   +2    , 
the  weights  are  just  one  greater  than  the  weights  of  1  through 
21   .   Starting  from  21  +  21    +1  and  going  on  to  2    ,  the 
weights  are  the  same  as  for  the  2    numbers  2   +2     -  1, 
2i  +  21"1  -  2 ,  . . . ,  21 . 

An  alternative,  and  somewhat  easier  way  of  computing 
the  NAF  is  provided  by  the  following  theorem,  due  to  Chiang 
and  Tsao-Wu: 

Theorem  2 . 2 

Let  bn_1,  ...,  b-p  bQ  and  aR_1,  ...,  a^  aQ  be  the 

radix-2  forms  of  the  positive  integers  3E  and  E  respectively; 
then,  the  coefficients  e-  defined  by 

ei  =  bi-l  "  ai+l  £or  i  =  °»  lj  ***'  n"2 

e.  =  0  for  i  >  n-1 

i  — 

are  the  coefficients  in  the  NAF  for  E. 

Proof 

We  note  first  that  3E  and  E  are  both  even  or  both  odd, 
so  that  bQ  =  aQ.   Hence, 
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n-2        n-2 

Z        e  21  =  1    (bi+1  -  a    321 
i=0   x      i=0     l  x 

n-1 

=  1/2  £    (b.  -  a.321 
i  =  0 

=  1/2  (3E-E)  =  E 

so  that  the  e.  are  certainly  the  coefficients  in  a  modified 

binary  form  for  E  and  it  remains  to  show  that  this  form  is 

nonadiacent,  i.e.,  that  e-e.  ,  =  0  for  all  i.   If  e-  =  0, 
J      '      '       i  l+l  l     ' 

there  is  nothing  to  show.   Suppose  then  that  e.  =  -1,  i.e., 

that  b.  ,  =0  and  a.  ,  =  1.   We  next  note  that  we  can  obtain 
l+l  l+l 

3E  by  adding  the  radix-2  forms  for  E  and  2E,  the  latter  being 
just  a  _2>  •••3-q,  0.   Hence,  the  coefficients  in  the  radix-2 
form  of  3E  are  given  by 

bi+l  =  ai+l  +  ai  +  ci  (mod  2) 

where  c  is  the  carry  bit  from  the  addition  which  save  b.. 
i  7  to     i 

But  by  hypothesis,  b.  ,  =  0  and  a-  ,  =1,  so  that  we  must 
J       J  r        '   l+l  l+l     ' 

have 

a,  +  c-  =  1  (mod  2) . 

Thus,  two  of  the  bits  being  added  to  give  b.+,  must  be  "ones" 
so  that  the  next  carry  c-  -,  =  1.   But  this  in  turn  implies 


b. 


i+2  =  ai+2  +  ai+l  +  ci+l  ^mod  ^ 


=   a.  - 

i  +  2 


so  that  e.  ,  =  b.^0  -  a.^0  =  0  and  hence  e.  e-  ■,    =    0,  as  was 
l+l     i+2     i+2  l   l-l     ' 
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to  be  shown.   An  entirely  similar  argument  holds  for  e.  =  +1 . 
In  simple  terms  Theorem  2.2  shows  that  the  NAF  of  a  positive 
integer  can  be  determined  by  the  bit  by  bit  radix-2  sub- 
traction of  3E  and  E.   Clearly,  if  E  is  negative  the  NAF  of 
E  can  be  obtained  by  first  evaluating  the  NAF  of  -E  and  then 
changing  the  sign  of  its  coefficients. 

Let's  introduce  the  convenient  notation  that,  in  a 
NAF  e   -j  ,  e   2  •••  e-  •••  en  the    symbol  I  in  the  j  th  position 
indicates  the  coefficient  e.  =  -1.   The  following  example 
illustrates  the  procedure. 

Ex       E  =  -  125      -E  =  125 
3  x  125  =  375       101110111 
125  1111101 

NAF  for  125        10000101 
NAF  for  -125       10000101 

As  an  immediate  consequence  of  Theorem  2 . 2  we  have  the  following 

Corollary  2 . 1 

The  number  of  places  required  for  the  NAF  of  E  (E  a 
positive  integer)  is  one  less  than  the  number  of  places 
required  for  the  radix-2  form  of  3E .   In  particular,  the  number 
of  places  required  for  the  NAF  of  E  is  at  most  one  greater  than 
the  number  of  places  required  for  the  radix-2  form  of  E. 

C.   ALGORITHM  TO  COMPUTE  NAF  AND  ARITHMETIC  WEIGHT 

Theorem  2.2  suggests  a  very  simple  and  convenient  algorithm 
to  compute  the  NAF  at  a  given  number,  and  consequently  to 
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determine  its  arithmetic  weight,  with  the  assistance  of  a 
digital  computer. 

Algorithm  2.1 

Step  (0).   Let  a   , ,  . . .  a,  ,  an,  be  the  radix-2  form 
r  n- 1       10 

for  a  positive  integer  E  such  that  a   ,  =  a   .,  =  0 .   Set  i  =  0 
r  a  n- 1    n- L 

and  c0  =  0. 

Step  (1) .   Calculate  in  order 

b.  ,  =  a.  ,  +  a.  +  c-  (mod  2) 
l  +  l     l  +  l     i     l  v      ' 

c.+,  =  carry  bit  from  the  above  addition 
ei  =  bi+l  "  ai+l- 

Step  (2).   If  i  =  n-2,  stop.   Otherwise,  increase  i 
by  1  and  return  to  step  (1) .   When  the  calculaton  has 
stopped,  e  _->  •••»  e->  en  i-s  the  desired  NAF  for  E. 

Very  often  we  are  interested  in  computing  only  the 
arithmetic  weight  of  a  number  E,  W(E)  .   The  following  algorithm, 
due  to  Garcia,  is  directly  inferable  from  algorithm  2.1  and 
permits  the  direct  calculation  of  W(E)  from  the  radix-2  form 
of  E,  without  the  computation  of  its  NAF. 

Algorithm  2.2 

Step  (1).   Let  [a  _ , ,  ...,  a,,  a«]  be  the  radix-2 

form  for  a  positive  integer  E  such  that  a   ,  =  a  n    =  0. 
r  °  n-1     n- 2 

Set  i  =  0,  W  =  0,  and  a  ,  =  0. 

Step  (2).  If  i  >  n-2,  stop.  Otherwise,  increase  i 
by  1  and  go  to  step  (1).  When  the  calculation  has  stopped, 
W  =  W(E) . 
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It  should  be  mentioned  that  Chiang  and  Reed     have 
given  an  algorithm  for  calculating  W(E)  that  does  not  require 
a  radix-2  form  for  E  as  a  starting  point  but  works  directly 
with  integers.   Also,  Goto  and  Fukumura      and  Chien  et  al . 

have  given  algorithms  for  the  computation  of  the  NAF  of 
E  based  upon  nonrestoring  binary  division. 

D.   ARITHMETIC  DISTANCE 

In  the  theory  of  error  correcting  codes  the  concept  of 
Hamming  distance,  the  Hamming  weight,  W(C,  +  C?)  where  C,  and 
C2  are  two  code  words,  is  shown  to  be  a  true  metric  of  the 
code  space. 

In  the  theory  of  arithmetic  codes  we  also  recognize  that 

the  arithmetic  weight  satisfies  the  following  properties  of 

« 

a  norm. 

W(E)  =  W(-E)  (2.5) 

W(E)  >  0  with  equality  if  and  only  if  E  =  0      (2.6) 
W(E  +  E')  <_   W(E)  +  W(E')  (2.7) 

Properties  2.5  and  2.6  follow  directly  from  definition  2.1 
for  arithmetic  weight.   Property  2.7  is  proved  by  noting  that 
if  the  NAF ' s  of  E  and  Er  are  added  digit-by-digit,  then  carries 
can  flow  only  into  the  adjacent  terms  where  the  digit-by-digit 
sum  is  zero,  hence  E  +  E'  can  certainly  be  written  as  a 
modified  binary  form  (which  may  not  be  an  NAF)  with  at  most 
as  many  nonzero  terms  as  the  sum  of  the  number  of  nonzero 
terms  in  the  two  NAF ' s  being  added.   But  W(E  +  E')  is  the 
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least  number  of  terms  in  any  modified  binary  form  for  E  +  E', 
so  that  2.7  follows. 

The  norm  properties  (2.5)  through  (2.7)  of  arithmetic 
weight  guarantee  that  a  true  metric  for  the  set  of  integers 
can  be  defined  as  follows . 

Definition  2 . 2 

The  arithmetic  distance  between  the  integers  I,  and  I2, 
denoted  D(I-,,  I?)  »  i-s  tne  arithmetic  weight  of  their  difference 
i.e.  , 

D(Ir  I2)  =  W(IX  -  I2)  (2.8) 

It  is  readily  checked  that  for  any  integers  I,,  I?  and 
I-,  the  following  three  properties  which  formally  define  a 
metric,  are  satisfied  by  arithmetic  distance: 

D(Ip  I2)  =  D(I2,  Ix)  (2.9) 

D(I,,  I2)  >_  0  with  equality  if  and  only  if 

l±    =  I2  (2.10) 

D(I1,  I2)  <  0(1^  I3)  +  D(I5,  I2)  (2.11) 

The  above  properties  which  are  called  the  symmetry,  positive- 
definite,  and  triangle- inequality  properties,  follow  directly 
from  (2.5),  (2.6)  and  (2.7)  respectively. 

As  a  consequence  of  (2.9)  through  (2.11),  any  set  of 
integers  with  arithmetic  distance  taken  as  the  measure  of 
"distance"  forms  a  true  metric  space.   This  fact  plays  an 
important  role  in  the  study  of  codes  for  the  correction  of 
errors  in  integer  addition. 
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Finally,  suppose  that  the  correct  result  of  some 
operation  is  the  integer  J  but  the  actual  result  is  I  =  J  +  E, 
where  E  is  an  error  with  W(E)  =  i.   It  follows  from  (2.8)  that 

D(I,  J)  =  i 

i.e.,  that  an  error  of  weight  i  in  some  result  causes  the 
erroneous  result  to  be  at  arithmetic  distance  i  from  the 
true  result. 

E.   ERROR  IN  COMPUTER  ARITHMETIC 

In  previous  sections  we  have  concluded  that  arithmetic 
weight  provides  a  good  criteria  to  measure  error  in  ordinary 
addition  of  integers.   However,  ordinary  arithmetic  is  not 
used  in  digital  computers .   Those  in  fact  perform  module  m 
arithmetic,  with  m  usually  either  2   or  2  -1.   The  corre- 
sponding arithmetics  are  respectively  known  as  two's  complement 
arithmetic  and  one's  complement  arithmetic.   In  Chapter  III 
these  arithmetics  will  be  considered  in  greater  detail,  but 
at  this  point  it  seems  useful  to  analyze  the  carry  propagation 
in  modulo  addition.   Our  objective  is  to  learn  what  happens 
when  an  error  is  made  in  the  carry  from  the  highest,  left- 
most adding  position  to  conclude  under  which  conditions,  if 
any,  such  an  error  will  show  up  in  the  result  as  a  single 
error,  when  measured  by  the  arithmetic  weight. 

A  suitable  way  of  analyzing  the  carry  propagation  from 

the  highest  adding  position,  supposing  that  the  adder  has  n 

adding  cells  (2  ,  2  ,  ...  2    ),  is  to  consider  the  result 

of  the  operation  2n-l  +  2n-l  or  2(2n-l). 
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Refer  to  Figure  2.2,  where  a  n  cell  adder  is  repre- 


sented 


n-1 


Fig.  2.2.   Binarv  Adder  Block  Diagram. 

The  question  we  are  addressing  is  how  to  connect  C   for 
m  =  2  ,  m  =  2  -1,  and  m  other  than  2   or  2  -1. 

Let's  proceed  this  analysis  for  the  three  cases  above. 
Case  1  -  m  =  2 

1  000 

+  1  000 

1  00  000 

For  this  case  the  carry  is  irrelevant  as  far  as  the  arithmetic 
is  concerned. 


n-l 


9 

->o 


Carry  Propagation  for  m  = 


,n 


n  <•>  -n-1 

Case  2.   m  =  2 

1  000 

1 000 

1  0  000 

-   _1 111  -(2n-l) 

0  0  001 

The  carry  propagates  to  the  least  significant  position  only 
An  error  in  the  carry  will  therefore  show  up  as  a  unitary 
weight  error. 


n 


Fig.  2.4.   Carry  Propagation  for  m  =  2  - 1 


For  these  two  cases  we  see  that  the  arithmetic  weight  of  any 
error  has  the  same  significance  as  it  has  for  the  ordinary 
addition  of  integers,  namely  that  t  failures  in  the  elemental 
adding  units  (each  failure  being  an  incorrect  modulo-two  sum 
or  an  incorrect  carry  bit)  still  creates  an  error  E  of  arith- 
metic weight  at  most  t  in  the  sum.   This  follows  from  the  fact 
that  the  carry  bit  generated  by  any  elemental  adding  unit 
flows  to  at  most  one  other  unit.   Thus,  the  arithmetic  weight 
of  an  error  is  still  an  appropriate  measure  of  the  amount  of 
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logical  manfunction  in  the  adder  just  as  it  was  for  the 
ordinary  addition  of  integers  in  radix-2  form.   It  should  be 
pointed  out  of  course  that  if,  in  an  elemental  adding  unit, 
the  logic  which  performs  the  modulo-two  addition  is  shared 
with  that  which  generates  the  carry  bit,  then  a  single  logical 
malfunction  can  create  an  error  of  arithmetic  weight  two.   This 
remark  applies  to  the  ordinary  addition  of  integers  as  well  as 
the  modulo  m  addition  for  m  =  2     or  m  =  2  . 
Case  5 

Suppose  now  for  illustration  that  m  is  for  example  13. 
Four  binary  positions  are  required  in  the  adder  so 
1000 
1000 
10000 
-  1101     (-13) 
0011 

It  follows  that  an  error  in  the  carry  from  the  left  most 
adding  unit  results  in  an  error  of  arithmetic  weight  W(E)  =  2. 


Fig.  2.5.   Carry  Propagation  for  m  =  13 
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III.   BASIC  THEORY  OF  AN  CODES 

An  AN  code  generated  by  a  positive  integer  A  is  the  set 
of  integers  AN  for  0  <_  N  <_  B .   From  the  definition  above,  it 
is  apparent  that  B  is  the  number  of  integers  in  the  code. 

The  integers  belonging  to  an  AN  code  will  be  referred  to 
as  the  code  points.   So  the  code  point  AN,  is  to  be  under- 
stood as  the  encoded  version  of  the  information  integer  N, . 

Since 

ANX  +  AN 2  =  A(N1  +  N2) 

the  ordinary  sum  of  the  code  points  N,  and  N?  is  the  code 
point  corresponding  to  the  integer  N,  +  N?,  provided 

N,  +  N2  <  B  (5.1) 

In  this  restricted  sense  AN  codes  are  linear,  and  are  some- 
times called  linear  residue  codes.  The  restriction  imposed 
on  the  linearity  of  AN  codes  is  that  expressed  in  (5.1). 

A.   MINIMUM  ARITHMETIC  DISTANCE  AND  ERROR  CORRECTION 

Definition  5 . 1 

The  minimum  arithmetic  distance  D    of  a  AN  code  is  the 

mm 

minimum  of  arithmetic  distances  between  all  pairs  of  distinct 
code  points.  The  linearity  of  AN  codes  leads  to  the  property 
given  in  the  theorem  below. 


51 


Theorem  3.1 

The  minimum  arithmetic  distance  D  .   of  an  AN  code  is 

equal  to  the  minimum  arithmetic  weight  W  .   of  the  B-l  non 
n  °  mm 

zero  code  points  in  the  code 


D  .   =  W  .   =  min  W(AN)     0  <  N  <  B 
mm    mm 


Proof 

If  AN,  and  AN2  are  code  points  with  N-,  >  N?,  then 

D(AN1,  AN2)  =  W[A(N1-N2)]  =  W(AN,) 

where  0  <  N,  =  N,  -  N0  <  B,  which  shows  that  the  distance 
j     1     Z 

between  any  pair  of  distinct  code  points  is  always  the  weight 
of  some  nonzero  code  point.   Conversely,  if  AN-  is  any  non- 
zero point,  then  < 

D(0,  AN3)  =  W(AN3) 

so  that  the  weight  of  every  nonzero  code  point  is  also  the 
distance  between  some  pair  of  distinct  code  points  and 
therefore  the  theorem  is  proved. 

The  minimum  arithmetic  distance  of  an  AN  code  determines 
its  capability  to  correct  and  detect  errors  in  its  code 
points.   We  next  establish  this  relation. 

In  the  discussion  to  follow  we  assume  that  the  correct 
result  of  some  operation  is  some  code  point  in  the  AN  code 
and  that  any  code  point  is  a  possible  result.   For  example, 
the  operation  might  be  addition  (without  overflow)  of  code 
points.   If  the  correct  result  is  AN,  but  the  actual  result 
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is  I  =  ANi+  E  we  will  say  that  an  error  E  has  occurred,  and 
call  E  the  actual  error. 

The  decoder,  which  is  the  device  which  does  the  actual 
error  correction  or  detection,  can  operate  only  on  the  actual 
result,  I.   The  basic  theorem  which  governs  the  error  correct- 
ing and  detecting  capability  of  an  AN  code  is  as  follows. 

Theorem  5 . 2 

For  any  t  >_  0  and  any  s  >_  0,  an  AN  code  can  correct  all 
errors  of  weight  t  or  less  in  its  code  points  and  can  detect 
all  other  errors  of  weight  t  +  s  or  less  in  its  code  points 
if  and  only  if  its  minimum  arithmetic  distance  satisfies 

D     >  2t  +  S 
mm 

Proof 

Suppose  that  D    >  2t  +  s.   We  next  show  that  the  decoder 
vv  mm 

which  decodes  the  result  I  into  the  nearest  code  point  AN,  if 

there  is  a  code  point  AN,  with  D(I,  AN,)  <_  t,  and  announces 

a  detected  error  if  t  <  D(I,  AN,)  <_  t  +  s  performs  the  claimed 

correction  and  detection.   For,  suppose  I  =  AN  +  E,  where  AN 

is  the  correct  result  and  W(E)  <_  t,  then,  D(I,  AN)  <_  t.   But 

for  any  other  code  point  AN',  we  have  by  the  triangle  inequality 

that  D(I,  AN")  >  D(AN,  AN')  -  D ( I ,  AN)  >  t  +  s,  so  that  N,  =  N 

and  the  error  is  corrected  as  claimed.   Similarly,  if 

t  <  W(E)  <_  t  +  s ,  then  for  any  other  code  point  AN',  D(I,  AN')  >  t 

so  that  no  code  point  within  distance  t  of  I  exists  and  a 

detected  error  will  be  announced  as  claimed. 

Conversely,  suppose  that  D    <  2t  +  s.   Then,  there  exist 
J  ^r  mm  —  ' 

distinct  code  points  AN  and  AN'  such  that  D(AN,  AN')  <  2t  +  s. 
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Let  AN  -  AN'  =  E'  -  E,  where  E'  is  the  sum  of  the  t  highest- 
order  terms  in  the  NAF  of  AN  -  AN'  and  -E  is  the  sum  of  the 
remaining  terms.   Hence,  W(E')  <  t  and  W(E)  <  t  +  s.   Now,  if 
the  actual  result  is 

I  =  AN  +  E  =  AN'  +  E' 

a  decoder  to  perform  the  claimed  correction  and  detection  would 
be  inconsistently  required  to  correct  E'  and  also  to  correct 
or  detect  E.   Hence,  a  decoder  to  perform  the  claimed  correction 
and  detection  does  not  exist,  and  the  theorem  is  proved. 

Since  our  interest  in  this  chapter  is  the  correction  of 
errors  in  computer  arithmetic,  we  shall  not  further  consider 
AN-codes  for  correcting  errors  in  unrestricted  integer  arithmetic 

B.   ARITHMETIC  MODULO  m 


It  has  been  pointed  out  in  Chapter  II  that  most  digital 
computers  perform  modulo  m  arithmetic,  where  m  is  either  2 
(two's  complement  arithmetic)  or  2  -1  (one  complement  arithmetic) 
For  any  positive  integer  m,  the  residue  of  an  integer  I, 
modulo  m  is  defined  to  be  the  remainder  resulting  from  the 
division  of  I  by  m,  and  will  be  denoted  hereafter  as  R  (I). 
In  other  words,  Rm(I)  is  the  unique  integer  in  the  range 

0  i  Rm(X)  <  m  such  that  X  "  Rm(I)  is  a  multiPle  o£  m-   For 
example,  R-(23)  =  R-,(-5)  =  2.   For  our  purposes,  the  two  most 

important  properties  of  residues  are 
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V1!  1  ^  =  Rm  ^clm  +  W  ±  c2m  1  Rm^2^  = 
Rm  [c,  ±c2)m  +  Rm(I13  iRmCI2)]  = 
R      [  Rm  ( I  -.  )    +    Rm(I7)]  (3.2) 

Similarly 

Those  properties  say  in  essence  that  if  only  the  residue  of  the 
final  result  is  of  interest,  then  the  residues  of  all  inter- 
mediate results  can  be  taken  without  changing  the  final  result. 

The  set  of  integers  Z   =  (1,  2,  ...  m-1)  form  a  ring  under 

°  m        '  ° 

modulo  m  addition,  which  we  denote  by  (+),  and  modulo  m  multi- 
plication, thereafter  denoted  by  (x). 

So,  I,  +  I?  =  Rm(Ii  0  I?)  is  the  ring  sum  and 

IX®.I2  =  V1!©^  (3-4) 

is  the  ring  multiplication.   The  ring  above  identified  is 
called  the  ring  of  integers  modulo  m,  and  the  ring  operations 
are  arithmetic  operations  modulo  m. 

In  a  digital  computer  the  arithmetic  unit  performs  arith- 
metic modulo  m,  and  the  actual  results  of  such  operations  are 

also  integers  in  Z  .   Moreover,  if  the  number  of  code  points 
°        m  r 

is  B,  it  is  convenient  to  choose  m  =  AB .   Then,  if  AN-,  and 

A^  are  any  code  points,  and  hence  necessarily  integers  in 

Z  ,  we  have 
m 

ANX©AN2    =    RAB[AN1    +   AN2]    =   ARB(N1    +   N2) 
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and  since  0  <_  Rd(ni  +  N2)  <  B,  it  follows  that  the  modulo  m 

sum  of  any  two  code  points  is  another  code  point.   Thus,  an 

AN-code  is  truly  linear  for  modulo  m  addition.   The  set  of 

code  points  is  closed  under  addition  modulo  m  and  thus  the 

code  is  a  group;  besides,  the  modulo  m  product  of  a  code 

point  with  any  integer  in  Z   is  another  code  point  so  that 

the  code  is  in  fact  an  ideal  in  Z  . 

m 

If  the  code  point  AN  is  the  correct  result  of  some 

operation  in  Z  ,  but  the  actual  result  is  I,  we  define  the 
r  m 

ring  error  F  as  the  unique  element  of  Z   such  that  I  =  AN  (+)  F , 

or  equivalently ,  F  =  I  0  AN .   Note  that  the  actual  error  E  is 

defined  as  I  =  AN  +  E  so  that  the  actual  error  E  is  either  F 

or  F  -  m  depending  on  whether  E  >  0  or  E  <  0,  respectively. 

Note  also  that  the  actual  error  mav  not  be  an  integer  in  Z  . 

°       m 

The  syndrome  S(I)  associated  with  the  possibly  erroneous 
result  I  =  AN  0  F  is  defined  to  be  the  residue  of  I  modulo  A, 
the  generator  of  the  code,  i.e.,  S(I)  =  R.(I) .   Since  m  =  AB , 
we  have 

S(I)  =  RA(I)  =  RA(AN0F)  =  RA(F)  (3.5) 

and  we  see  that  the  syndrome  depends  only  on  the  ring  error 

which  has  occurred,  and  we  commonly  speak  of  Ra(F)  as  the 

syndrome  of  the  ring  error  F.   The  importance  of  the  syndrome 

is  that  it  uniquely  identifies  which  ring  errors  are  consistent 

with  the  result  I . 

Lemma  5 . 1 

For  any  I  in  Z  ,  the  set  of  integers  F  in  Z   such  that 
1  nr  &  m 

I  =  AN  0'  F  for  some  code  point  AN  is  the  set  of  ring  errors 
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^A(Ai  +  Fi)  =  RACFi)  =  S(Fi)  for  all  o£  these  B  ring  errors 


whose  syndrome  is  S(I).   This  set  is  the  set  of  ring  errors 
consistent  with  I  and  contains  precisely  B  distinct  ring 
errors . 

Proof 

The  possible  ring  errors  are  the  distinct  F.  such  that 

I  =  Ai@F.,        0  <  i  <  B 
so  there  are  precisely  B  such  ring  errors.   Moreover  S(I)  = 

The  A  different  possible  values  for  S(I)  together  with  the  B 

ring  errors  as  given  above  with  the  syndrome  S(I)  account  for 

all  m  =  AB  ring  errors  in  Z  ,  so  no  ring  errors  except  the 
&  m  °  r 

F.  given  above  can  have  the  same  syndrome  S(I). 

In  coding  for  arithmetic  in  Z  ,  one  generally  first  speci- 
fies a  set  T   of  ring  errors  which  one  desires  to  correct. 

c       & 

That  is,  for  an  error  F  in  T   and  a  result  such  that 

c 

I  =  AN  0  F,  one  wishes  the  decoder  to  correct  the  result  I  to 

its  true  value  AN.   In  practice,  one  would  always  assign  F  =  0 

to  T   since  one  would  certainlv  wish  the  decoder  to  pass 
c  J  r 

correct  results  unchanged  to  the  user,  but  this  assumption  is 

not  necessary  in  the  following  theory.   Similarly,  one  generally 

specifies  another  set  T,  of  ring  errors  (which  may  be  the  empty 

set)  disjoint  from  T   which  one  desires  to  detect.   That  is, 

c 

for  an  error  F  in  T,  and  a  result  I  such  that  I  =  AN  ©  F ,  one 
wishes  the  decoder  to  announce  a  detected  but  uncorrectable 
error.   The  following  theorem  gives  the  necessary  and  suffi- 
cient conditions  for  determining  whether  such  error  correction 
and  detection  is  possible  for  a  given  AN-code. 
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Theorem  3 . 3 

Let  T   and  T\  be  any  disjoint  subsets  of  Z  .   Then,  an 

c      d      '     J  m 

AN-code  (with  m  =  AB)  can  correct  all  ring  errors  in  T  in 

its  code  points  and  can  detect  all  ring  errors  in  T,  in  its 

code  points  if  and  only  if  there  is  no  ring  error  F,  in  T 

which  has  the  same  syndrome  as  some  other  ring  error  F.-,  in 

either  T   or  T,. 
c     d 

Proof 

If  the  distinctness  condition  on  the  syndromes  holds, 

and  if  I  =  AN  0  F  for  some  F  in  T  ,  then  Lemma  3.1  implies 

that  no  other  error  F'  in  T  or  T,  is  possible  so  that  I  can 

be  unambiguously  decoded  to  AN  or  a  detected  error  unambiguously 

announced  if  there  is  no  such  F  in  T  .   Conversely,  if  the 

c 

distinctness  condition  does  not  hold,  i.e.,  if  S(F,)  =  S(F~) 

for  some  F,  in  T   and  some  other  F-,  in  T   or  T -, ,  then  by 

1     c  2      c     d'        J 

Lemma  3.1  both  F,  and  F-,  are  possible  errors  for  the  result 
I  =  F,  and  hence  a  decoder  would  be  inconsistently  required 
to  correct  F,  and  to  correct  or  detect  F?  . 

The  above  proof  for  Theorem  3.3  indicates  a  possible  pro- 
cedure for  correcting  error  in  modulo  m  addition  with  AN 
coded  operands.   First,  one  could  compute  the  syndrome  S(I) 

from  the  actual  result  I,  and  then,  if  an  error  F  in  T   has 

c 

occurred,  to  look  up  its  value  in  a  table  of  syndromes  for 
the  ring  errors  in  T  .   A  detected  error  is  announced  if  S(I) 
does  not  appear  in  the  table.   After  F  has  been  found,  the 
result  I  is  corrected  to  the  value  I  QF.   If  the  actual 
result  of  an  arithmetic  operation  is 

I  =  AN  +  E  =  AN  0  F 
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the  actual  error  E  is  either  F  if  E  >  0,  or  F  -  m  if  E  <  0. 
In  consequence  the  arithmetic  weight  of  the  actual  error  is 
either  W(F)  or  W(  -F)  since  W(F-m)  =  W(m-F) .   W(E)  has  been 
previously  shown  to  be  an  appropriate  measure  of  the  adder 
malfunction  for  modulo  m  addition  with  m  =  2  -1  or  m  =  2  . 
We  study  next  a  way  of  measuring  ring  error  which  was  proposed 
by  Ras  and  Garcia. 

Definition  3. 2 

The  modular  weight  of  an  integer  F  thereafter  denoted  W  (F) 
is  the  minimum  between  W(F)  and  W(  -F) .   It  is  apparent  from 
the  above  definition  that 


W  (F)  <  W(F) . 


It  is  easily  verified  that  the  modular  weight,  for  any  m, 
satisfies  two  of  the  three  norm  properties,  namely 

WfF)  =  Wf-F)  (3.6) 

mm  *•    J 

and 

W  (F)  >  0  equality  holding  only  if  F  =  0.        (3.7) 

The  triangle  inequality 

Wm(F,  0F,)  <_   Wm(F1)  +  Wm(F2)  (3.8) 

does  not  hold,  however,  for  arbitrary  m.   Nevertheless,  it 
does  hold  for  the  cases  of  greatest  interest,  namely 
m  =  2  -1,  m  =  2   and  m  =  2  +1,  as  we  will  show  in  the  follow- 
ing theorem  due  to  Garcia.   The  proof  of  this  theorem  is 
lengthy  and  tedious.   But  in  face  of  its  importance  a  complete 
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proof  will  be  presented  for  the  case  of  m  =  2  -1.   This  proof 
gives  some  insight  into  why  the  triangle  inequality  fails  for 

arbitrary  m,  and  may  easily  be  changed  for  the  cases  where 

-.n        tII^  , 
m  =  2   or  m  =  2  +1 . 

Theorem  3.4 

For  any  integers  F,  and  F7  in  Z  ,  the  triangle  inequality 
(3.8)  for  modular  weight  is  satisfied  if  m  is  any  of  the 
moduli  2n-l,  2n,  or  2n+l. 

Proof 

Suppose  first  that  W  (F^  =  W(Fj)  and  Wm(F2)  =  W(  -F7)  . 
If  also  F,  +  F7  <  m'  we  have 

w  (Fi  ©  F-0  =  W  (F,  +  F,)  <  W(m  -  F.  -  F,) 
m^  1  ^  2J  mv    1     2J    —      v  1     2J 

and  thus  by  the  triangle  inequality  for  arithmetic  weight  (2.7), 
W  (Ft  ©F7)  <  W(F-i)  +  W(™  "  F-,)  =  W  (F.)  +  W  (F9) 

so  the  theorem  is  proved  for  this  case.   Similarly,  if 
F-  +  F2  >  m, 

Wm(Fl  ©F2}  =  VF1  +  F2  "  m)  -   W(F1  +  F2  "  m) 
so  that  again  by  (2.7)  we  have 

Wm(F1  9   F2)  <  W(F1)  +  W(m  -  F,)  =  Wffl(F1)  +  VF2} . 

This  completes  the  proof  for  W  (F,)  =  W(F.)  and  W  (F.)  = 
r  r  ml       K    I  mK    lJ 

W(  OF?)  ,  and  by  symmetry  for  W  (F.,)  =  W(  QF  )  and  W  (F?)  = 
W(F7) .    We  note  that  we  have  not  yet  made  use  of  our  hypothesis 
on  the  form  of  m. 
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Suppose,  momentarily,  that  the  theorem  holds  when 

W  (F,)  =  W(F,)  and  W  (F9)  =  W(F7) .   Then  the  theorem  also 
m  1       1       m  L  L 

holds  for  Wm(F1)  =  W(  QF^  and  Wm(F2)  =  W(  QF 2) ,  since  then 
by  property  (3.5) 


W 


m 


(Fx  0F2)  =  Wm[(  QF1)  ®  (  OF2)]  <  Wm(  0FX)  +  Wm(  QF  2) 

=  W  (F,)  +  W  (F9) . 
m^  1J  mK    2J 


Hence,  the  theorem  will  be  proved  if  we  can  prove  it  for  the 

case  where  W  (F,)  =  W(F,)  and  W  (FJ  =  W(F0),  as  we  now  proceed 
mv  1J  *-  \J  vxy    2J  y    2J  '  ^ 

to  do . 

If  also  F,  +  F2  <  m,  we  have 

W  (F,  0  F9)  =  W  (F-,  -  F9)  <  W(F,  +  F9) 
mv    1     2J  mv  1     2^—^-1     2J 

and  again  we  have,  according  to  (2.7) 

W  (F,  ©  F-)  <  W(F,)  +  W(F9)  =  W  (F,)  +  W  (F,) . 
mv    1  w  2J    —   v  1J  K    2J  itk  1J  mv    2J 

If  F,  +  F?  =  m,  we  have  W  (F-,  ©  F9)  =  0 ,  so  the  theorem  holds 
trivially. 

It  remains  to  consider  the  case  F,  -  F9  >  m.   We  now 
impose  our  restriction  on  m  and  suppose  first  that  m  =  2  -1. 
By  our  hypotheses, 

m  =  2n-l  <  F1  +  F2  <  2m  <  2n+1 . 

It  follows  from  Corollary  2.1  that  the  NAF  of  F,  +  F9  is  given 
by  the  (n  -  2)-tuple  [b   -,  ,  b  ,  ...,  b,,  bQ],  where  either 
(bn+1,  b  )  is  (0,1)  or  (1,0).   In  the  former  case,  the  te: 


rm 
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+  2n  appears  in  the  NAF  of  F,  +  F2,  and  hence 
W(F1  +  F2  -  2n)  =  W(F1  -  F2)  -  1. 

Thus, 

VF1  ©  F2}    =   VF1  +  F2    "    m)    -  W(F1    +    F2    "    m) 
=   W(F1    +    F2    -    2n    +    1) 

can  be   overbounded  using   the    triangle    inequality    (2.7)    as 

VF1  ®  F2}    -  W(F1    +    F2    "    2ll}    +   W(1)    =   W(F1    +    F2}  ' 

Again  using  (2.7)  we  conclude 

W  (F,  ©FJ  <  W(F-.)  +  W(F9)  =  W  (F,)  +  W  (F-) 
m^  1    2y  —   v  1^     v    2J  mK    1J  my    2J 

Finally,  we  must  consider  the  case  when  (b   - ,  b  )  =  (1,0), 
i.e.,  when  +2     is  a  term  in  the  NAF  for  F-.  -  F?  .   Repeating 
the  same  steps  as  above,  we  find 

W(Fn  +  F^  -  2m)  <  W(F,  +  F.)  <  W  (F, )  +  W  (F.) 
v    1  2  J    —   ^  1     2J    —  mv  1J  mv  2J 

But  also  from  (3.6)  we  have 

VF1  ®  F2}  =  Wm[(  ^Fl}  0  (  °F2)]  =  Wm[(m  "  *V  0  (m  "F2)] 

Noting  that  0  <  2m  -  F,  -  F7  <  m,  it  follows  that 

Wm(F1  ©F2)  =  Wm(2m  -  F:  -  F2)  <  W(2m  -  Fx  -  F2) 
=  W(FX  -  F2  -  2J 

where  we  made  use  of  (2.5)  in  the  last  step.   It  follows  that 
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again 

W  (F,  ©  F9)  <  WfFJ  +  WfF7) 
m^  1  ^  2^  —  mv  1^     mv  Z' 

so  that  the  theorem  is  proved  for  the  modulus  m  =  2  -1. 

It  follows  from  the  norm  properties  (3.6)  through  (3-8) 
that  for  the  moduli  2  -1,  2  ,  and  2  +1,  we  can  use  modular 

weight  to  define  a  distance  function  for  Z   just  as  we  used 

°  m  J 

arithmetic  weight  to  define  a  distance  function  for  any  set 

of  integers. 

Definition  3.3 

The  modular  distance  between  the  integers  I,  and  L  in  Z  , 

°  1      2     m' 

where  m  is  one  of  the  moduli  2  -1,  2  ,  or  2  +1,  is  the  modular 

weight  of  their  difference  and  will  be  denoted  D  (It,  I-,), 
°  m  1 '  lJ  * 

i.e., 

V1!,  l2)    -   V1!©^  C3.9D 

It  follows  immediately  from  (3.6)  -  (3.8)  that  the  modular 
distance  is  a  true  metric  for  Z  satisfying  the  three  defining 
properties  for  a  metric. 

Dm(Il'  I2)  =  Dm(I2>  Il)  (3-10) 

D    (I-.,    I?)    ^_  0   with    equality   holding    only    for    I,     =    I7 

(3.11) 

Dm(I1,    I9)    <    D    fl,,    I,)    -    D    (I-,    I9)  (3.12) 

m^    1'       2      —     m^    1'       1>J  mK    :> '       2 

For  the  special  cases  where  the  modulo  m  is  2   or  2  +1 ,  the 
minimum  modular  distance  of  an  AN  code  is  the  minimum  of  the 
modular  distances  between  pairs  of  distinct  code  points. 
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Theorem  3.5 

For  an  An-code  where  m  =  AB  is  one  of  the  moduli  2-1,2, 
or  2n+l,  the  minimum  modular  distance  and  the  minimum  arithmetic 
distance  coincide. 

Proof 

We  know  that,  for  N-.  -  N2  =  N3  >  0 

Dm(AN1,  AN2)  =  Wm[A(N1  -  N2) ]  =  min  [W(AN3) ,  W(AN4)] 


where  N.  =  B  -  NT  which  shows  that  the  modular  distance  between 
4        3 

distinct  code  points  is  always  the  arithmetic  weight  of  some 
nonzero  code  point.   Hence,  the  minimum  modular  distance  cannot 
be  smaller  than  W    ,  the  minimum  arithmetic  weight  of  the  non- 
zero  code  points.   Conversely,  if  ANr  is  a  code  point  of  weight 


W 


m 


•  ,  then 
m' 


D  (0,  ANC)  <  W(ANC)  =  W  • 
mv    '         5y  —   ^   5J     mm 


so  that  the  minimum  modular  distance  cannot  exceed  W  .  .   It 

mm 

follows  that  the  minimum  modular  distance  is  exactly  W  .   and 

J      mm 

hence  by  Theorem  3.1,  exactly  equal  to  the  minimum  arithmetic 

distance  of  the  code. 

As  a  consequence,  we  will  use  the  symbol  D  .   for  both  of 
n      '  y       mm 

these  minimum  distances . 

A  fundamental  theorem,  analogous  to  Theorem  3.2  for 
arithmetic  distance  is  introduced  next: 

Theorem  3.6 

For  any  t  >_  0  and  s  >_  0 ,  an  AN-code  where  m  =  AB  is  one 
of  the  moduli  2  -1,  2  ,  or  2  +1  can  correct  all  ring  errors 
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of  modular  weight  t  +  s  or  less  in  its  code  points  if  and  only 
if  its  minimum  modular  distance  satisfies 


D  .   >  2t  +  s . 
mm 


Proof 

Suppose  that  D    >  2t  +  s.   We  shall  show  that  the  decoder 
rr  mm 

which  decodes  the  result  I  into  the  nearest  code  point  AN,  if 

there  is  a  code  point  AN,  with  D  [I.  AN,)  <  t,  and  announces 

t-        i  m^  '    1^     ' 

a  detected  error  otherwise,  performs  the  claimed  correction  and 

detection.   For,  suppose  I  =  AN  0  F,  where  AN  is  the  correct 

result  and  W  (F)  <  t.   Then,  D  (I,  AN)  <  t,  but  for  any  other 
m    —  mv  '     —  ' 

code  point  AN',  we  have  by  the  triangle  inequality  (3.12)  that 

D  (I,  AN')  >  D  (AN,  AN')  -  D  (I,  AN)  >  t  +  s 

m^  '     J    —  itt   '     -*     mv  '    J 

so  that  N,  =  N  and  the  error  is  corrected  as  claimed.   Similarly 
if  t  <  W  (F)  <_  t  +  s ,  then  for  any  other  code  point  AN', 


D  (I,  AN')  >  t 

m^  '  J 


so  that  no  code  point  within  distance  t  of  I  exists  and  a 

detected  error  will  be  announced  as  claimed. 

Now,  suppose  that  D  .   <  2t  +  s .   Then,  there  exist  distinct 
'    ^  mm  —  ' 

code  points  AN  and  AN'  such  that 
D(AN,  AN')  <  2t  -  s. 


Let 


AN  -  AN'  =  E'  -  E 
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where  E'  is  the  sum  of  the  t  highest-order  terms  in  the  NAF 

of  AN  -  AN'  and  -  E  is  the  sum  of  the  remaining  terms.   (Note 

that  E  or  E'  may  not  be  an  integer  in  Z  .)   Define  the  ring 

errors  F  and  F*  as  F  =  R  (E)  and  F'  =  R  (E ' )  .   The  same  type 

m^  m  r 

of  argument  used  in  the  latter  part  of  the  proof  of  Theorem 
3.4,  i.e.,  consideration  of  the  NAF;s  of  E  and  E',  shows  that 
for  any  of  the  moduli  2n-l,  2n,  or  2n  +  l ,  W  (F)  <_  W(E)  <_   t  +  s 
and  W  (FT)  <_  W(E')  <_  t.   But  it  follows  also  from  the  property 
(3.2)  of  residues  that 

AN'  ©AN  =  R  (ANf  -  AN)  =  R  (E  -  E*)  =  F  Q  F ' 

and  hence  that 

AN  0  F  =  AN'  ®F' 

where  F  and  F'  are  distinct  ring  errors  with  W  (F)  <  t  +  s  and 

W  (FM  <  t.   Thus,  if  the  actual  result  of  some  operation  is 
m     —  r 

I  =  AN  Q   F  =  AN '  0  F ' 

then  a  decoder  to  perform  the  claimed  correction  and  detection 
would  be  inconsistently  required  to  correct  F'  and  also  to 
correct  or  detect  F,  and  hence  does  not  exist,  which  proves 
the  theorem. 

C.   PERFECT  AN  SINGLE  ERROR  CORRECTING  CODES 

The  sphere  of  radius  t  about  a  point  I  in  Z   is  defined 
r  r  m 

as  the  set  of  all  integers  J  in  Z   such  that  D  (I,J)  <  t. 

&  m  m v  '    — 

The  volume  of  such  sphere  is  the  number  of  integers  in  the 
sphere.   The  volume  of  a  sphere  is  also  equal  to  the  number 
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of  integers  F  in  Z  with  W  (F)  <  t,  since  J  =  I  @F  is  in  the 
°  m       m    —  " 

sphere  if  and  only  if  W  (F)  <_   t.   The  volume  of  a  sphere  is 
independent  of  its  center  I. 

Suppose  an  AN-code  with  m  =  AB  can  correct  all  ring  errors 
F  of  modular  weight  t  or  less.   Then  the  spheres  of  radius  t 
about  each  of  its  code  points  must  be  disjoint  since  otherwise 
there  would  be  a  possible  result  I  at  modular  distance  t  or 
less  from  two  code  points  so  that  one  of  the  two  corresponding 
errors  of  modular  weight  t  or  less  could  not  be  corrected.   But 
since  there  must  be  B  such  disjoint  spheres  each  with  V  points 
and  also  there  are  only  a  total  of  m  integers  in  Z  ,  it  follows 
that  any  AN-code  capable  of  correcting  t  or  fewer  errors  must 
satisfy  the  inequality 

BV   <  m  =  AB  or 

Vt  <_   A  (3.13) 

which  is  a  bound  corresponding  precisely  to  the  well  known 
Hamming  bound  for  parity  check  error  correcting  codes .   An  AN- 
code  is  said  to  be  a  perfect  code  or  a  sphere  packed  code  if 
the  bound  in  equation  (3.13)  holds  with  equality.   Consider 
an  AN-code  with  generator  is  a  prime  number  A  =  p.   Then  the 
set  of  integers  modulo  A  is  a  field  G(p)  under  addition  and 
multiplication  modulo  A.   Before  proceeding  to  the  presenta- 
tion of  the  next  theorem,  let's  recall  that  in  a  field  G(p) 
if  a  is  a  primitive,  then 
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a0  =  1 
a1  =  a 

a   =  a  ©  a 

n    n-1  * 

a=a    ©a      n<p 

p-1 

ar 


are  all  distinct  elements  of  G(p) .   Also  to  simplify  the 
notation  in  the  proof  to  be  given  next,  recall  that  in  arith- 
metic modulo  p,  an  integer  is  represented  by  R  (I).   So 
p  =  R  (p)  =  0.   Also,  the  additive  inverse  of  a  <  p  is 
-a  =  R  (-a)  =  p-1. 

Theorem  3 . 7 

If  A  is  an  odd  prime  p  and  if  2  is  a  primitive  in 
G(p)  then: 

(a.)      A  generates  a  code  with  D  -   =3  and  B  =  2  +1 

v      to  mm 

where  n  =Cl/2) (A-l) . 

(b)  Also,  if  R  (-2)  =  p-2  is  a  primitive  in  G(p) 
but  2  is  not,  then  A  generates  a  code  with  same  distance  and 
B  =  2n-l. 

(c)  The  codes  given  by  this  theorem  are  perfect 
codes . 

Proof 

If  A  is  prime,  then 

2A-1  .x  .  (2(A-l)/2  +  r)    x  (2(A-l)/2  ,1}  .  0_ 

If  2  is  a  primitive  then  2^    * '       f   \    and  so 
2(A-D/2  +  1    ,  „  „  2(A-l)/2  . 
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As  a  consequence,  the  consecutive  powers  of  2 

i   7   72        ?(A-3)/2   2(A-l)/2  =   ,   .2 

_2(A-3)/2 

are  all  distincts.   In  fact,  they  are  all  nonzero  elements  in 
G(p) .   So  all  possible  weight  F  error  have  distinct  syndromes, 

and  by  Theorem  3.3  part  (a)  of  the  theorem  holds.   If  ©  2  is 

2       (A-  31/2 
primitive,  then  1,  2,  2   ...  2^    J/      must  be  distinct  since 

their  squares  are.   Also  none  is  equal  to  0  1 ,  for  if  2^    =  01 

for  some  j  <_  (A-3)/2,  then  2  J  =  1  =  (  ©  2)i°  for  some 

2j  <_  A-3,  which  is  impossible  if  0  2  is  primitive.   Again, 

(2(A-l)/2_  1)  (2(A-l)/2  +  d  =  0<   If  ((a-D/2  is  even, 

2(A-l)/2  m    (02) (A-l)/2  ^  ,.  hence  2(A-l)/2  =  .  lf   Then>  2  is 

primitive  and  part  a  applies.   If,  on  the  other  hand,  Q  2  is 
primitive  and  2  is  not,  then  (A-l)/2  must  be  odd.   Then, 
2^    *'       -    1  =  0,  and  the  syndrome  of  the  weight-1  errors  1, 
Q2,  22,  ....  Z^'^Ol,  -2,022,  ....  0  2(A-3)/!  are 
distinct.   By  Theorem  5.3  part  b  holds. 

Conversely,  Theorem  3.3  implies  that  if  a  or  b   holds, 
all  the  residues  mod  A  must  be  congruent  to  +_  2    ,    and  A  must 
be  odd.   Then  2,  and  therefore  all  the  residues  mod  A,  are 
relatively  prime  to  A,  so  that  A  must  be  prime.   Then  the 
residues  mod  A  form  a  field.   The  order  of  2  is  at  least  (A-l)/2 
since  the  smaller  powers  of  2  have  distinct  residues.   But  the 
order  of  2  must  divide  A-l,  so  it  must  be  either  A-l  or  (A-l)/2. 
The  same  is  true  of  Q  2.   If  the  orders  of  both  2  and  0  2  are 
(A-l)/2,  then  +2-  is  always  an  even  power  of  a.   This  is  im- 
possible.  Therefore,  either  2  or  0  2  must  have  order  A-l,  that 
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is,  be  primitive.   It  remains  to  be  shown  that  the  code  is 
perfect . 

The  errors  of  weight  1  or  less  are  just  the  integers 


0  or  2   and 


2n  -  2J'  -1  for  0 


<  j  <  n 


So  there  are  2n  +  1  integers,  and  the  volume  of  radius  1 
sphere  in  Zm  is 

V1  =  2n  +  1  =  2(^li)  +  1  =  A. 

Table  I   presents  some  codes  given  by  Theorem  3.7. 
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Table  I 
Some  Perfect,  Single  Error  Correcting  AN  Codes 


A 

B 

M 

BITS  (N) 

BITS  (AN) 

CLASS 

11 

3 

33 

2 

r 

3 

N 

13 

5 

65 

3 

6 

N 

19 

27 

513 

5 

9 

N 

23 

89 

2047 

7 

11 

C 

29 

565 

16385 

10 

14 

N 

37 

7085 

262145 

13 

18 

N 

47 

178481 

8388607 

18 

23 

C 

53 

1266205 

67108865 

21 

26 

N 

59 

9099507 

536870913 

24 

29 

N 

61 

17602325 

1073741825 

25 

30 

N 

67 

128207979 

8589934593 

27 

33 

N 

71 

483939977 

34359738367 

29 

35 

C 

79 

6958934353 

549755813887 

33 

39 

C 

R;  T=0.52/0.94  16.08.07 

A  =  code  generator 

B  =  number  of  code  points 

M  =  A  x  B  =  modulo  of  arithmetic  performed  by  adder 

BITS  (N)  =  number  of  bits  required  to  represent  the  largest 

integer  (B-l) 
BITS  (AN)  =  number  of  bits  required  to  represent  the  largest 

code  point 
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IV.   CYCLIC  AN  CODES 

In  this  chapter  we  will  study  a  very  important  class  of 
arithmetic  codes:   the  cyclic  AN  codes.   The  cyclic  nature 
of  some  AN  codes  was  apparently  first  noticed  by  Mandelbaum  in 
1967. 

The  radix-two  form  of  a  code  point  is  of  great  interest, 
since  it  is  the  way  code  points  are  represented  in  digital 
computers.   By  analogy  with  parity  check  error  correcting 
codes  we  will  thereafter  refer  to  this  representation  as  a 
code  word.   Since  a  code  word  is  a  representation  of  a  code 
point  we  will  use  the  two  expressions  as  equivalents  whenever 
it  seems  appropriate. 

Definition  4.1 

The  cyclic  shift  T(N)  of  a  number  N  e    Z  with  radix-two 

form  is  [a   , ,  a  n,     .  .  .  ,  a-,  ,  an]  is  another  number  N   £  Z 
L  n- 1 '   n- 2 '     '   1*   0J  s     m 

which  is  represented  in  radix-two  form  by  the  n-typle 

^an-2'  an-3'    *'  a'  V   n-1^' 

Definition  4.2 

A  cyclic  AN  code  is  an  AN  code  which  is  closed  under  cyclic 

shifting.   Consider  a  cyclic  AN  code  with  a  code  point  AN-,  e  Z 
to  y  r       1     m 

such  that  its  corresponding  code  word  is  of  the  form  111... 111. 

This  code  is  said  to  include  an  all  one  code  word,  and  has 

D  .   <  2  since  the  distance  between  the  all  one  code  word  and 
mm  — 

the  0  word  is  two.  Such  a  code  is  therefore  of  little  interest. 
But  the  all  one  code  word  necessarily  corresponds  to  the  largest 
code  point.   As  a  consequence,  if  we  remove  this  code  point  from 
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the  code  the  remaining  set  of  numbers  is  still  a  cyclic  AN  code 
In  this  chapter  we  will  only  consider  those  cyclic  AN  codes 
which  do  not  include  an  all  one  code  word. 

In  Chapter  II  we  have  discussed  the  carry  propagation  in 
addition  modulo  m.   We  have  verified  then,  that  in  addition 
modulo  m  =  2  -1,  the  carry  propagates  from  the  most  significant 
binary  position  into  the  least  significant  binary  position. 
Therefore,  for  modulo  m  =  2  -1 

T(AN)  =  AN©  AN  =  2  ©AN  (4.1) 

what  implies  that  a  AN  code  such  that  AB  =  2n-l  is  closed  under 
cyclic  shifting  and  therefore  cyclic.   This  observation  is 
expressed  in  the  following  theorem. 

Theorem  4 . 1 

An  AN  code  with  B  code  points  is  cyclic  if  and  only  if  A 
generates  an  ideal  in  Z  ,  the  ring  of  integers  modulo  M  =  AB  = 
2n-l. 

Proof 

The  sufficiency  of  the  condition  given  by  the  theorem  has 
been  proved  before  by  showing  that 

T(AN)  =  2  ©  AN  £  Z 

Conversely,  if  a  cyclic  AN  code  includes  the  code  word 

x  =  sn-l'  xn-2'  •■•'  x'  x0  =  AK  then 

y  =  xn„7'  xn-3'  *••'  xi  '  xn '  xn-l  ^"S  a^-so  a  c°de  word 
and  hence  a  multiple  of  A. 
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n-2  (   2AK,  xn.1  =  0 

y  =  £_    x.  2     +  a   ,  =  < 

i  =  0    x        n_i    (_  2AK-(2n-l)  ,       xn_1  =  1 

For  7  to  be  a  multiple  of  A  it  is  required  that  A  divides 

2  -1.   Hence  A  generates  an  ideal  in  Z  . 

°  m 

As  a  consequence  of  Theorem  4.1  we  will  assume  that  the 
modulus  m  is  given  by  m  =  AB  =  2  -1,  throughout  the  remainder 
of  our  discussion  on  cyclic  AN  codes.   To  represent  integers 
modulo  2  -1,  n  binary  digits  are  required.   It  is  therefore 
natural  to  think  of  the  integer  n  as  the  code  length.   Again 
borrowing  the  terms  from  the  theory  of  error  correcting  codes 
used  in  communications,  we  define  the  code  rate  R  to  be  the 
ratio  of  the  base  two  logarithm  of  the  number  of  code  points 
to  the  base  two  logarithm  of  the  total  number  of  integers  in 
the  ring  Z  ,  i.e., 

R  =  (log2B)/(log2m)  =  (log2B)/(log2A  +  log2B)    (4.2) 

The  quantity  log7A  is  called  the  redundancy  of  the  code,  and 

is  an  approximate  measure  of  the  number  of  extra  binary  portions 

required  to  represent  the  code  points  as  opposed  to  those 

required  to  represent  the  original  integers  without  coding. 

Suppose  now  that  a  cyclic  AN  code  has  D     =  W    =  1 . 
rr  '  mm    mm 

Then,  2   must  be  a  code  word  for  some  i,  0£i£n,  and  hence 
1  must  be  a  code  point  since  2   is  i  cyclic  shifts  of  1.   It 
follows  that  A  must  be  1  and  we  have  proved: 
Theorem  4 . 2 

Every  cyclic  AN  code  with  A  >  1  had  D  .   >  2.   The  codes 

'  mm  — 

with  A  =  3  are  the  least-redundant  codes  satisfying  Theorem  4.2 
and  have  Dmin  exactly  2  for  B  >  1  since  W(A)  =  2.   Noting  that 
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3=2-1  divides  2  -1  if  and  only  if  n  is  even,  we  have  as  an 
immediate  consequence: 

Corollary  4.1 

For  every  even  n  greater  than  two,  A  =  3  generates  a 
cyclic  AN-code  with  B  =  (2  -l)/3  code  points  and  D  -   =  2. 
These  codes  can  detect  all  single  modular  errors  in  their 
code  points. 

We  show  next  that  there  is  a  natural  length  n,  determined 
entirely  by  A,  for  cyclic  AN  codes  generated  by  A.   We  first 
remark  that  Theorem  4.1  shows  that  A  must  be  odd  if  A  generates 
a  cyclic  AN  code. 

For  any  positive  odd  integer  A,  the  exponent  of  2  modulo  A, 
denoted  e (A) ,  is  the  least  positive  integer  i  such  that  A 
divides  2  -1.   From  (3.2),  we  see  that  an  equivalent  statement 
is  that  i  is  the  least  positive  integer  such  that  R.(21)  =  1. 
We  show  first  that  e (A)  is  always  well-defined.   Consider  the 
sequence  of  numbers  11.(2-*),  j  =1,  2,  3,  ....   Since  A  is  odd, 
it  cannot  divide  2-1  for  any  j  ,  so  that  these  numbers  are  all 
between  1  and  A-l  inclusive.   But  then  there  must  be  specific 
integers  j  and  k  with  Kj^rk  A  such  that  RA(2J)  =  R,(2  )  .   By 
(3.2),  this  is  equivalent  to 


R 


A 


[2j(2k"j  -1)]  = 


k-  i 
which  implies  that  A  divides  2   J  -1,  since  A  is  odd.   This 

proves  that  e(A)  is  always  well-defined  for  every  positive  odd 
integer  and  also  that  e (A)  <_  A  - 1 .   A  continuation  of  this  ar- 
gument shows  further  that  the  sequence  of  residues  R.(2^), 
j  =1,  2,  3,  ...,  is  periodic  with  period  e(A)  and  hence 
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that  A  divides  2  -1  if  and  only  if  n  is  a  multiple  of 
e(A). 

If  A  generates  a  cyclic  AN  code  of  length  n,  it  follows 

from  Theorem  4.1  that  A  divides  2n-l  and  hence  that  n  is  a 

e  (A) 
multiple  of  e (A) .   If  n  >  e (A) ,  then  2  v  *    -1  is  a  code  point 

since  it  is  a  multiple  of  A  less  than  AB  =  2  -1.   Hence 

(assuming  A  >  1) ,  the  AN   code  has  D  .   =2  since  it  has  a 

*■       5      J  *  mm 

code  point  of  arithmetic  weight  two.   In  view  of  the  fact 
that,  except  for  A  =  3,  cyclic  AN  codes  with  D  =  2  are  of 
little  interest,  we  will  adopt  the  convention  that,  unless 
otherwise  specified,  the  length  n  of  the  cyclic  AN  code 
generated  by  an  odd  positive  integer  A  is  to  be  taken  as 
e(A),  the  exponent  of  2  modulo  A. 

Theorem  4.5 

The  cyclic  AN  code  generated  by  an  odd  integer  A  (A  >  1) 

has  D  •   >  5  if  and  only  if  either 

mm  —  J 

(a)  e(A)  is  odd,  or 

(b)  e(A)  is  even  but  A  does  not  divide  ieW/2    +1. 
Proof 

The  only  possible  code  points  with  arithmetic  weight  two 
are  2-1  and  2   +1  for  0  <  i  <  n  =  e (A) .   Since  i  <  e (A) , 
2  -1  is  not  divisible  by  A  and  hence  is  not  a  code  word.   If 

2  +1  is  a  code  point  and  hence  divisible  by  A,  then  2^1-1  = 

i        8 
(2  +1)  (2  -1)  is  also  divisible  by  A,  so  that  2i  must  be  a 

multiple  of  e(A).   Since  i  <  e (A) ,  this  is  impossible  if  e(A) 

is  odd  and  requires  e(A)  =  2i  if  e (A)  is  even.   Thus,  2e *■  >'    +1 

is  the  only  possible  code  point  with  arithmetic  weight  two  and 
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will  be  an  actual  code  point  if  and  only  if  it  is  divisible 
by  A.   This  proves  the  theorem. 

Example 

Take  A  =  21.   We  have  then  RA(2J)  =  2,  4,  8,  16,  11,  1 

for  j  =  1,  2,  3,  4,  5,  6.   Hence  n  =  e (A)  =  6  for  the  cyclic 

AN  code  generated  by  A  =  21.   We  note  that  e (A)  is  even  but 

A  =  21  does  not  divide  2e(^/2  +1  =  9,  so  that  Dm.   >  3  by 

mm  —    J 

Theorem  4.3.   In  fact,  W(21)  =  W(24  +  22  +  2°)  =  3,  so  that 

D    =3.   This  single-error  correcting  code  has  B  =  (2  -l)/4  = 
mm  5  &  K 

3  code  points. 

We  are  now  in  a  position  to  recognize  that  the  codes  given 
by  Theorem  3.7  (b)  are  cyclic  codes.   In  fact,  they  are  the 
best,  less  redundant,  cyclic  AN  codes  with  distance  3.   The 
codes  listed  in  Table  I    and  identified  with  C  are  of  this 
category . 


A.   NEGACYCLIC  AN  CODES 

It  is  interesting  at  this  point  to  open  a  brief  paren- 
thesis to  a  comment  on  another  class  of  codes  related  to  that 
of  cyclic  AN  codes,  the  so  called  negacyclic  AN  codes.   We 
have  shown  that  in  addition  modulo  m  =  2  -1  the  carry  generated 
is  the  highest  binary  position  propagates  to  the  lower  position 
We  have  also  related  this  observation  with  the  cyclic  character 

■p 

of  AN  codes  with  m  =  AB  =  2-1.   Similarly  in  addition  modulo 
m  =  2  +1  we  can  easily  see  that  the  carry  generated  at  the 
highest  binary  position  is  subtracted  from  the  lowest  binary 
position.   This  fact  gives  the  negacyclic  character  of  AN 
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2 
codes  such  that  m  =  AB  =  2   +  1.   The  codes  given  by 

Theorem  3.7(a)  are  of  this  category.   Also  some  of  those 

codes  with  D  .   =3  are  listed  in  Table  I,    where  marked 
mm 

with  N. 


B.   CALCULATION  OF  D  .   FOR  CYCLIC  AN  CODES 

mm 

In  this  section  we  will  verify  that  the  search  for  the 
code  point  with  minimum  arithmetic  weight  in  a  cyclic  AN 
code  can  be  limited  to  one  sixth  of  its  code  points.   First, 

notice  from  Corollary  2.1  that  every  nonzero  I  e  Z   for 

J  *  m 

m  =  2  -1  has  an  (n+1)  position  NAF  [b  ,  b   ,  ,  .  .  .  ,  b-.  ,  b~] 
and  also  that  from  Theorem  2.2. 

(bn,  bn_1)  =  (0,0)     for  0  <  31  <  2n  (4.3) 


(bn,  b'^)  =  (0,1)     for  2n  <  31  <  2 


n  +  1 


(4.4) 
(bn,  bn_1)  =  (1,0)     for  2n+1  <  31  (4.5) 


This  suggests  separting  the  set  of  integers  in  Z   into  the 
corresponding  three  disjoint  subsets  characterized  by  the  two 
highest  coefficients  in  their  NAF ' s .   For  simplicity,  we  shall 
now  adopt  an  interval  notation  for  sets  of  integers  and  write 
(a,b)  or  (a,b]  to  denote  the  set  of  integers  I  such  that 
a<I<bora<I^b,  respectively,  where  a  and  b  are  any 
real  numbers.   In  particular,  the  sets  of  integers 

L3m  =  (0,  2n/3)  (4.6) 

M3m  =  (2n/3,  2n+1/3)  (4.7) 

U3m  =  (2n+1/3,  2n)  (4.8) 


are  precisely  the  sets  of  integers  I  e  Z   satisfying  (4.3), 
(4.4)  and  (4.5)  respectively,  and  hence  our  desired  partition 
of  the  nonzero  integers  in  Z 


m 
Lemma  4 . 1 


For  an  integer  I  £  Z 
&        m 


W(I)   if  IeM3m  and  I  is  even,  or  if  IeL3m 


W  (I)  = 
m 

W(m-I)  otherwise. 

Proof 

Case  A,  IeL3m. 

By  (4.3)  the  NAF  of  I  has  two  leading  zeros  so  that 
W(2n-1)  =  W(I)  +1.   Thus,  W(m-I)  =  W(2n-I-1)  W(2n-I)  -  w(l)  = 
W(I)  where  the  inequality  follows  from  the  triangular  in- 
equality for  arithmetic  distance  (2.7)  since  distance  is  just 
the  weight  of  the  difference.   Hence  W  (I)  =  W(I)  as  claimed. 

Case  B,  l£U3m. 

Now  (m-I)  =  2n  -1  -I  belongs  to  L3m  so  that  W  (I)  =  W(m-I) 
by  Case  A  above. 

Case  C,  IsM3m. 

Now  W(I)  =  W(2n-I).   If  I  is  odd,  then  2n-l  is  also  odd 
and  in  M3m.   Since  2  -I  is  odd,  subtracting  one  cannot  increase 
its  weight  so  we  have  W(2n- 1  - 1)  <W(2n- 1)  =  W(I)  and  hence  W  (I)  ■■ 
W(m-I).   If  I  is  even,  then  2  -1-1  is  odd  and  in  M3m.   The  same 
argument  then  gives  W  (2n-l-I)  =  W(K)  but  W  (m-I)  =  W  (I)  so 
W  (I)  =  W(I).   Thus,  the  theorem  is  proved. 

The  subsequent  discussion  will  be  easier  if  we  use  the 
following  Lemma,  due  to  Hartman. 
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Lemma  4 . 2 

For  an  integer  IeZ 

°      m 

W  (I)  =  W  [T(I)]. 

mv  *  mL  *■  J  J 

Proof 

Case  A,  I<2 

If  IeL3m,  then  either  T(I)eL3m  or  T(I)£M3m  is  even.   In 
either  case  W  [T(I)]  =  W[T(I)]  =  W(I)  =  W  (I).   If  IeM3m  and 
is  even  then  W  [T(I)]  =  W(2n-1-2I)  =  W(2n-2I)  +  1  since  the 
NAF  of  2n  -  21  ends  in  two  zeros.   Since  2IeU3m,  W(2n  -21)  = 
W(2I)  -1.   Hence  by  Lemma  4.1  W  [T(I)]  =  W(2n-1-2I)  =  W(I)  = 


W  (I)  . 

m^  J 


Suppose  finally  that  IeM3m  and  I  is  odd.   Then 


W(2n-I)  =  W(I)  and  W(2n-2I)  =  W(I)  -  1. 


There  are  only  two  possible  types  of  endings  for  the  NAF  of 
I.   They  are  either  0,  -1,  followed  by  any  number  (including 
none)  of  repetitions  of  0,  1;  or  0,  0,  1,  followed  again  by 
any  number  (including  none)  of  repetitions  of  0,  1.   With 
the  first  type  of  ending  we  have: 


W(2n-I-1)  =  W(2n-I)  =  W(I)  -  1  and 
W(2n-2I-1)  =  W(2n-2I)  =  W(I)  -  1. 


With  the  second  type  of  ending  we  have: 


W(2n-I-1)  =  W(2n-I)  =  W(I)  and 
W(2n-2I-1)  =  W(2n=2I)  +1  =  W(I) 


Thus  for  either  type  of  ending  we  have 
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W  (I)  =  W(2n-I-1)  =  W(2n-2I-1)  =  W  [T(I)]. 
m  m 

Case  B,  P211"1. 

Let  J  =  2n-l-I. 

Now  Wm[T(I)]  =  Wm[m-T(I)] 

=  W  [2n-l-(2I-2n+l)] 

=  W  [2J]. 

But  W  (2J)  =  W  (J)  since  J  <  2n-l  and  by  Case  A  above. 

Hence  W  [T(I)1   =  W  (J)  =  W  (I)  which  completes  the  proof, 
m  mm  r  r 

Lemmas  4.1  and  4.2  give  us  the  tools  to  derive  the  following 

theorem. 

Theorem  4 . 5 

In  every  cyclic  AN  code  there  is  always  at  least  one  code 

point  ANt  in  L3m  with  N,  odd  such  that  WfAN, )  =  W  ■  . 
r       1  1  1     mm 

Proof 

For  any  AN2  in  U3m,  -  AN2  =  m  -  AN-,  is  in  L5m  and  has  the 
same  modular  weight.   If  AN2  is  in  M3m  and  is  odd,  then  -  AN2 
is  also  in  M3m  and  is  even  and  has  the  same  modular  weight. 
Finally,  for  AN9  in  M3m  and  even,  AN?  is  the  cyclic  shift  (and 
hence  by  Lemma  4.2  has  the  same  modular  weight)  as  AN7/2,  which 
is  in  L3m.   Similarly,  the  even  code  points  in  L3m  are  some 
cyclic  shift,  and  hence,  have  the  same  modular  weight,  of  odd 
code  points  in  L5m.   Thus,  there  is  always  a  nonzero  odd  code 
point  in  L3m  with  minimum  modular  weight.   But  by  Lemma  4.1 
modular  and  arithmetic  weights  coincide  in  L3m.   Hence,  there 
is  always  a  nonzero  odd  code  point  in  L3m  whose  arithmetic 
weight  is  also  the  minimum  modular  weight  in  the  code.   But 
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this  minimum  modular  weight  coincides  with  the  minimum  arith- 
metic weight  W    since  the  modular  weight  of  any  code  point 

°  mm 

is  at  most  its  arithmetic  weight. 

Theorem  4.5  shows  that  the  search  for  the  minimum  weight 

code  point  in  a  cyclic  AN  code  can  be  restricted  to  one  sixth 

of  the  code  points,  namely  those  odd  code  points  in  L3m.   Let 

us  now  take  a  deeper  look  into  the  properties  of  the  code 

points  in  L3m.   We  begin  by  noting  that  the  NAF ' s  of  code 

points  in  L3m,  according  to  (4.3),  have  n-place  NAF ' s 

[b  _, ,  .  . . ,  b,  ,  b~]  which  are  cyclically  nonadjacent,  that  is 

b   ,  bn  =  0.   Thus  if  these  NAF's  are  cyclic-shifted,  then  the 
n- 1   0  ; 

result  is  always  again  an  n-place  NAF- -although  it  may  be  the 

NAF  of  an  integer  not  in  L3m  nor  even  in  Z   since  after  some 
to  m 

cyclic  shifts,  the  NAF  might  have  -1  as  its  highest  nonzero 

coefficient . 

Suppose  now  that  IeL3m.   We  define  J.,  0<_i<n  as  an  integer 

whose  n-place  NAF  is  the  ith  cyclic  shift  of  the  NAF  for  I  =  J~ 

J-  is  not  restricted  to  be  positive.   We  note  that  J;+i    is 

obtained  from  J-  by  first  doubling  J.  and  then,  if  the  leading 

coefficient  in  the  NAF  for  J-  were  nonzero,  subtracting  or 

adding  m  =  2  -1  according  as  this  coefficient  were  +1  or  -1. 

It  follows  that  R  (J-^i)  =  R  (2J.)  and,  with  the  aid  of  (3.3) 

m   l+l     m^   i 

that 

R  (J.)  =  R  (2XJn)  =  R  (2XI),  0<i<n  (4.9) 


Noting  next  that  J.  has  an  n-place  NAF  and  hence  a  magnitude 
less  than  m  =  2n-l,  it  follows  from  (4.9)  that 
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(J.  for  J.  >  0 

R  (2XI)  =  )  1  x  (4.10) 

m       /j.  +  m  for  J.  <  0 
1  i  i 


Next,  we  observe  that  if  [b  _,,  ...,  b,,  bQ]  is  the  NAF  of 

I  =  Jn .    then  b   ,  -  is  the  leftmost  digit  in  the  n-place  NAF 
0        n-l-i  &  r 

for  J-.   But  according  to  (4.3)  this  leftmost  digit  will  be 

+1  if  and  only  if  J-  =  R  (2  I)  is  in  M3m  and  this  leftmost 
J  i    it. 

digit  will  be  +1  if  and  only  if  -J.  =  m  -  R  f2  I)  is  in  M3m. 

Now  from  (4.6)  we  see  that  for  any  K  in  Z  ,  K  and  m  -  K  are 

either  both  in  M3m  or  neither  is  in  M3m.   It  follows  that 

are  either  both  in  M3m  or  neither  is  in  M3m.   It  follows  that 

b   ,    is  nonzero  if  and  only  if  R  (2  I)  lies  in  M3m.   But 
n- 1  -  i  *  m K 

the  arithmetic  weight  of  I,  by  Theorem  2.1  is  just  the  number 
of  nonzero  digits  in  the  NAF  of  I,  so  that  we  have  proved: 

Theorem  4.6 

For  every  integer  I  in  L3m,  its  arithmetic  weight  W(I)  is 
equal  to  the  number  of  residues  R  (2  I),  0  <  i  <  n  which  lie 
in  M5m  =  (2n/3,  2n+1/3) . 

Application  of  Theorem  4.6  to  the  calculation  of  the 
arithmetic  weight  of  a  code  point  AN,  in  L3m  is  facilitated 
by  noting  that  since  m  =  AB ,  then 


Rm(21AN1)  =  RAB(21AN1)  =  ARg(21N1)  (4.11) 

so  that  R  (21AN1)  lies  in  M3m  if  and  only  if  ARD(21N,)  lies 
ml  J  Bl 

in  M3m,  which  in  turn  occurs  if  and  only  if  RR(21N-])  lies  in 
the  set  of  integers  (B/3,  2B/3].   We  have  then  as  an  immediate 
corollary  of  Theorem  4.6: 


63 


Corollary  4.2 

For  any  cyclic  AN-code  and  any  code  point  AN,  in  L3m, 
W(AN,)  is  equal  to  the  number  of  residues  RR(2  N,)  which 
lie  in  the  interval  (B/3,  2B/3]. 

C.   MANDELBAUM- BARROWS  CODES 

The  class  of  equidistant  cyclic  AN  codes  to  be  discussed 
in  this  section  is  of  great  importance  in  the  development  of 
the  theory  of  AN  codes.  Besides  the  fact  that  they  were  the 
first  systematically  constructed  class  of  AN  codes  with 

D    >  3,  they  were  the  first  AN  codes  to  be  recognized  as 

mm    '     !  & 

cyclic. 

In  addition  they  constitute  an  important  step  in  the 
attempt  to  establish  analogies  between  the  theory  of  AN  codes 
and  that  of  the  parity  check  error  correcting  codes.   Those 
codes  were  discovered  independently  by  Mandelbaum  and  Barrows 
Mandelbaum  was  the  only  one  who  noticed  their  cyclic  nature, 
while  Barrows  calculated  their  exact  minimum  distance. 

Lef's  define  INT(r),  where  r  is  a  positive  real  number 
as  the  integer  part  of  r.   The  formulation  of  Mandelbaum- 
Barrows  code  is  next  made  in  the  following  theorem. 

Theorem  4 . 7 

If  B  is  any  prime  such  that  2  is  primitive  in  GF(B),  then 

R  - 1 

A  =  (2     -  1)/B  generates  an  equidistant  cyclic  AN-code  of 

length  n  =  B  -  1  and  minimum  distance  D  .   =  int [ (B+ll /3] . 

5  mm       L  *■    J       J 

Proof 

If  B  is  a  prime  p  for  which  2  is  primitive  in  GF(p) ,  then 
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e(B)  =  e(p)  =  B  -  1 

Let's  choose  the  generator  A  and  the  code  length  such  that 
A  =  (2e(B)  -  1)/B  =  (2B_1  -  1)/B  and 
n  =  B  -  1. 
Since  2  is  primitive  in  GF(p)  =  GF(B),  the  residues 

RT>(21),    0<i<n  =  B-l 

are  all  the  B  -  1  nonzero  elements  of  GF(B) .   It  follows  also 
from  (3.4)  that  for  any  N,  ,  0<N,<B,  the  residues  Rg(21N  ), 

0<_i<n  =  B  -  1,  are  also  all  the  B  -  1  nonzero  elements  of 
GF(B)  since  they  are  just  the  modulo  B  product  of  the  residues 
in  the  former  set  by  the  fixed  nonzero  element  N,  in  GF(B). 
It  then  follows  from  Corollary  4.2  that  all  the  code  words  in 
L3m  have  arithmetic  weight  int[(B  +  l)/3],  and  further  by 
Theorem  4 . 5  that 

Dm.   =  W.   =  int[(B  +  l)/3] 
mm    mm      u       ' '     J 

In  addition,  we  know  from  the  proof  of  Theorem  4.5  that  the 
modular  weight  of  any  nonzero  code  point  coincides  with  the 
arithmetic  weight  of  a  code  point  in  L5m.   Hence,  all  the 
code  points  in  the  entire  code,  except  0,  have  modular  weight 
int[(B  +  l)/3].   But  also  the  modular  distance  between  any 
pair  of  distinct  code  points  is  the  modular  weight  of  some 
nonzero  code  point.   Thus,  the  modular  distance  between  any 
pair  of  distinct  code  points  is  exactly  int[(B  +  l)/3],  so 
the  code  is  equidistant. 
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Table  II  gives  a  complete  list  of  Mandelbaum-Barrow  codes 
with  n  less  than  37. 


Table  II 
Mandelbaum-Barrows  codes  (n<36) 


B 

n 

A 

D  . 
mm 

Redundancy 

3 

2 

1 

1 

0 

5 

4 

3 

2 

1.6 

11 

10 

93 

4 

6.5 

13 

12 

315 

4 

8.3 

19 

18 

13, 

,797 

6 

13.8 

29 

28 

9 

,256: 

,392 

10 

23.2 

37 

36 

1,857 

,283 

,155 

12 

30.8 

Despite  their  great  theoretical  importance  Mandelbaum- 
Barrow  codes  are  highly  redundant,  since  n  binary  digits  are 
required  to  represent  B  =  n-1  code  points,  and  therefore, 
are  not  attractive  for  practical  applications. 

D.   INTERMEDIATE  DISTANCE  CYCLIC  AN  CODES 

We  have  discussed  previously  single  error,  perfect 
cyclic  AN  codes,  given  by  Theorem  5.7,  and  the  large  distance 
equidistant  Mandelbaum-Barrow  codes.   It  would  be  of  great 
theoretical  importance  and  also  of  considerable  practical 
interest  if  classes  of  cyclic  AN  codes  with  both  intermediate 
distance  and  redundancy  could  be  found.   Unfortunately,  there 
are  not  at  present  any  systematically  constructed  classes  of 
cyclic  AN  codes  falling  in  this  category.   Nevertheless,  some 
specific  codes  have  been  discovered  by  trial  and  error 
techniques.   Some  of  those  codes  are  given  in  Table  III. 

66 


B 


n 


TABLE  III 
Some  Intermediate  Distance  Codes 

A  D  . 


Redundancy 


20 

25,575 

11LJ.11 

41 

6 

14.7 

113 

28 

2 

,375,535 

6 

21.8 

151 

15 

217 

4 

7.8 

233 

29 

2 

,304,167 

8 

21.2 

241 

24 

107,415 

4 

16.1 

331 

30 

3 

,243,933 

6 

21.6 

337 

21 

6,223 

5 

12.6 

601 

25 

55,831 

7 

15.8 

683 

22  • 

6,141 

4 

12.6 

1103 

29 

486,737 

7 

18.9 

1801 

25 

18,631 

5 

14.2 

2089 

29 

256,999 

6 

18.0 
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E.   ANALOGY  BETWEEN  AN  CYCLIC  CODES  AND  CYCLIC  PARITY  CHECK 
CODES 


To  point  out  the  analogies  between  cyclic  AN  codes  and 
cyclic  parity  codes,  let's  briefly  recall  the  key  ideas  in 
the  theory  of  algebraic  codes. 

With  a  polynomial  f(X)  =  fQ  +  f^X  +  . . .  +  fn-1  Xn_1  of 
degree  less  than  n  with  coefficients  in  a  field  F,  one 
associates  the  vector  f  =  [fn_i>  •••>  f i »  fn]   in  the  vector 
space  Fn.   A  parity-check  code  is  simply  a  set  of  such  vectors 
which  form  a  subspace  of  F  ,  i.e.,  which  is  closed  under 
addition  of  vectors  and  scalar  multiplication  of  vectors  by 

the  elements  in  F.   The  minimum  Hamming  distance  d  •   of  such 

°  mm 

a  code  is  defined  as  the  least  number  of  positions  in  which 
two  distinct  vectors,  or  code  words,  differ.   The  Hamming 
weight  of  a  vector  —  or  code  word — is  the  number  of  its  non- 
zero components.   It  is  verified  that  the  minimum  distance  d  . 
r  mm 

in  the  code  is  always  equal  to  the  Hamming  weight  of  the  non- 
zero vector  of  minimum  Hamming  weight  in  the  code.   The  code 
is  cyclic  if  the  cyclic  shift  of  every  code  word  is  again  a 
code  word.   The  cyclic  shift  of  f  results  in  a  vector  whose 
corresponding  polynomial  is  obtained  by  multiplying  f(X)  by 
X  modulo  X   -  1.   Let  g(X)  be  a  monic  (i.e.,  highest  co- 
efficient unity)  polynomial  of  minimum  degree  among  the  non- 
zero f(X)  in  the  code.   Then,  the  necessary  and  sufficient 
condition  for  the  code  to  be  cyclic  is  that  g(X)  divide 
X   -  1  and  that  every  polynomial  multiple  of  g(X)  with  degree 
less  than  n  be  a  code  word  and  that  all  code  words  are  of  this 
type.   It  follows  that  g(X)  is  unique  in  a  cyclic  code  and  is 
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called  the  generator  polynomial  of  the  code.   The  code  is 
therefore  an  ideal  in  the  ring  of  polynomials  modulo  X   -  1. 
We  recognize,  therefore,  that  if  we  make  2  correspond  to 
X,  g(X)  to  A,  Hamming  weight  to  arithmetic  weight,  and  so  on 
the  analogy  between  cyclic  AN  codes  and  cyclic  parity  check 
error  correcting  codes  is  evident  and  very  strong. 


F.   THE  BCH  CONJECTURE  FOR  AN  CODES 

The  parallels  between  cyclic  AN  codes  and  cyclic  parity 
check  error  correcting  codes,  discussed  briefly  in  the 
previous  section,  led  many  theorists  to  believe  that  there 
must  exist  for  cyclic  AN  codes  a  bound  analogous  to  the  Bose- 
Chaudhuri-Hocquenghen  (BCH)  bound  for  cyclic  parity  check 
codes. 

We  next  address  very  briefly  this  question. 

BCH  Bound 

If  ot  is  a  primitive  n   root  of  unity  in  the  extension 
field  E  of  a  field  F  and  g(X)  is  a  polynomial  over  F  dividing 
x  -1  and  having  d-1  consecutive  powers  of  a  among  its  roots, 
then  the  minimum  Hamming  distance  of  the  cyclic  parity-check 
code  of  length  n  generated  by  g(X)  is  at  least  d. 

To  pursue  the  possibility  of  a  BCH  type  of  bound  for  AN- 
codes  we  find  some  concepts  from  algebra  and  number  theory 
helpful.   The  cyclotomic  polynomial,  Q- (x) ,  is  the  polynomial 
having  real  coefficients  whose  roots  are  all  and  only  the 
primitive  i    roots  of  unity  among  the  complex  numbers .   The 


first  four  Q-  (x)  are 
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Qi(X)  =  x-1 

Q2(X)  =  x+1 

Q3(X)  =  x2+x+l 

Q4(X)  =  x2+l 

In  general  Q-(X)  generated  by  dividing  X  -1  by  the  product 
of  all  Q-(X)  such  that  j<i  and  j  divides  i,  to  eliminate  the 
non-primitive  roots  of  -1  from  the  set  of  roots  of  the  result- 
ing polynomium. 

The  integer  A.  =  Q-(2)  is  called  the  i    cyclotomic  number 
We  note  that  2  -1  has  at  least  as  many  factors,  A.,  as  there 
are  factors  of  n  since  2  -1  divides  2  -1  if  and  only  if  i 
divides  n.   Except  for  A?  =  Afi  =  5   A-  f   A-  when  i  f   j. 

To  establish  a  possible  basis  for  a  BCH  bound  for  cyclic 
AN  codes  we  can  factorize  the  generator  A  of  a  length  n  code 
as  a  product  of  integers  A  - ,  where  i  divides  n,  then  count 
the  number  of  consecutive  powers  of  a  =  1         '      among  the  roots 
of  the  corresponding  Q. (X) . 

The  factorization  referred  above  is  not  unique  in  general. 
We  must,  therefore,  find  a  rule  to  decide  which  are  the  "true" 
factors  of  A. 

A  possible  way  to  resolve  this  question  is  as  follows: 
When  there  is  more  than  one  way  to  write  A  as  the 
product  of  distinct  A-'s,  i  dividing  n,  and  a  constant  not 
divisible  by  any  other  A-'s  where  i  divides  n,  then  choose 
the  way  that  yields  the  largest  number  of  consecutive  powers 
of  cC  among  the  roots  of  the  corresponding  cyclotomic  poly- 
nomials Qi(X)  associated  with  the  factors  A..   In  this  setting 
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we 


always  consider  A,  =  1  to  be  one  of  the  distinct  factors 


of  A.  of  A.   In  counting  consecutive  powers  of  a,  a  ,  which  is 
aroot  of  Q, (X) ,  is  considered  to  be  adjacent  to  both  a    and 
a   since  a11  =  a  .   Let's  now  state  the  following. 

BCH  Conjecture 

A  cyclic  AN-code  that  has  t   consecutive  powers  of 
a  among  the  roots  of  the  cyclotomic  polynomials,  Q • (X)  where 
i  divides  n,  that  correspond  to  the  factors  A.  in  some 
factorization  of  A  has  a  minimum  arithmetic  distance  of  at 
least  (£+  l)/2.   The  BCH  conjecture  above  was  proposed  by 
Hartman  in  1975,  after  having  proved  false  a  previous  con- 
jecture introduced  by  Chien-Hong  in  1970.   Hartman' s  conjecture 
has  been  proved  valid  for  some  special  cases,  and  also  was 
shown  to  hold  for  all  cyclic  AN  codes  with  length  n  <_  70,  by 
means  of  extensive  computer  search. 
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V.   SEPARATE  CODES 
A.   BASIC  CONCEPTS 

As  pointed  out  in  Chapter  I,  it  is  often  desirable  to 
have  the  coded  words  in  an  encoding  system  as  consisting  of 
the  original  set  of  symbols  N,  concantenated  with  a  separated 
set  of  check  symbols  C (N) 

N   =  NoC(N) 

N  will  be  referred  to  as  the  information  integer,  and  C(N)  as 
the  check  integer.   If  a  system  like  that  described  in  the 
previous  paragraph  is  used  to  check  the  proper  operation  of 
an  adder,  it  is  also  desirable  to  make  sure  that  the  hardware 
involved  in  the  check  processing  is  independent  of  the  basic 
adder  itself.   This  will  prevent  the  possibility  that  a  single 
defective  part  might  affect  simultaneously  the  checker  and  the 
adder,  resulting  in  an  improperly  corrected  or  even  undetected 
error . 

As  a  consequence  of  the  previous  thoughts,  the  problem  of 
defining  an  encoding  system  suitable  to  the  generation  of  a 
separate  arithmetic  code  for  addition  can  be  stated  as  follows 

(a)  Define  a  rule  to  generate  C(N)  given  N,  and 

(b)  Find  an  operation  *  such  that 

C(N1  +  N2)  =  C(N1)*C(N2)  (5.1) 
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Fig.  5.1  represents  a  block  diagram  of  an  adder  designed 

to  use  a  separate  code  for  error  correction  and/or  detection. 

The  reader  is  familiar  with  an  error  detecting  code  that 
meets  the  above  characterization.   The  well  know  "nines  out 
proof"  for  addition,  that  can  be  described  as  follows: 

1.  Represent  the  operands  by  its  decimal  representa- 
tion followed  by  its  residue  modulo  9  so  C(N)  =  Rg(N). 

2.  Perform  normal  addition  on  the  decimal  representa- 
tion of  the  operands  (their  information  integer) .   Compute 

the  residue  modulo  9  of  the  result  (the  check  integer  of  the 
result) . 

5.   Perform  modulo  9  addition  (here  the  operation  *) 
on  the  check  integers  of  the  operands.   Compare  with  the  result 
of  2  for  the  check  integer  of  the  result. 

This  simple  illustration,  taken  from  everybody's  elementary 
school  experience,  besides  being  a  simple  example  of  separate 
codes,  has  the  additional  virtue  of  inducing  in  the  reader's 
mind  the  idea  that,  unlike  AN  codes,  separate  codes  can  be 
found  that  will  be  capable  of  checking  both  addition  and 
multiplication.   This  would  be  a  very  significant  advantage 
over  AN  codes,  since  many  arithmetic  units  are  desired  to 
perform  multiplication  as  well  as  addition.   A  very  good 
insight  into  the  nature  of  separate  codes  is  given  by 
Theorem  4.1,  due  to  Peterson. 

Theorem  5 . 1 

If  there  are  fewer  check  symbols  than  integers  in  the 
permissible  range  of  integers,  and  if  the  check  symbols  C(N) 
satisfy  Equation  5.1,  then  C(N)  must  be  the  residue  of  N  mod  b 

73 


N. 


N. 


C(N2) 


r 


Nl  +  N2 


C(N1)*C(N2)  =  C(NX  +  N,) 


Fig.  5.1.   Adder  Using  Separate  Code  - 
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Block  Diagram 


in  a  coded  form,  where  b  is  the  number  of  distinct  check 
symbols,  and  *  is  addition  modulo  b. 

Proof 

Let  S  denote  the  set  of  all  integers  N  that  have  the 
same  check  symbol  as  zero;  that  is,  C (N)  =  C(0).   The  first 
step  in  the  proof  is  to  show  that  S  is  an  ideal  in  the  ring 
of  integers.   By  definition,  zero  is  in  S.   Note  that  C(0)  = 
C(0  +  0)  =  C(0)*C(0),  and  therefore,  C(0) *C(0) * . . .  *C(0)  =  C(0), 
no  matter  how  many  factors  appear  on  the  left.   Thus,  if  a  is 
in  S,  then  Na  =  a  +  ...  +  a  is  in  S,  for 

C(Na)  =  C(a  +  a  +  ...  +  a)  =  C (a) *C (a) * . . . *C (a) 
=  C(0)*C(0)*. . .*C(0)  =  C(0)  . 

Also,  if  a  is  in  S, 

C(-a)  =  C(0-a)  =  C(0)*C(-a)  =  C(a)*C(-a) 
=  C(a-a)  =  C(0) 

and  therefore  -a  is  in  S  also.   Thus,  S  is  an  ideal. 

Next,  note  that  C(N,)  =  C(N7)  if  and  only  if  N-,  and  N7  are 
in  the  same  residue  class  of  S.   This  is  shown  as  follows: 

C(N2)  =  C(N1)*CCN2-N1) 

If  N,  and  N7  are  in  the  same  residue  class,  N7-N,  is  in  S  and 
C(N2  -  N1)  =  C(0) . 

C(N2)  =  C(N1)*C(0)  =  C(N1+0)  =  C(N1) 
On  the  other  hand,  if  C (N  )  =  C(N9),  then 
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CCN2-NXD  =  C(N2)*C(-N1)  =  C(N1)*C(-N1) 

=  C(NfN1)  =  C(0); 

therefore,  N2~N,  is  in  the  ideal  S,  and  N2  and  N,  are  in  the 

same  residue  class  of  S.   Note  that  this  means  that  if  two 

different  integers  N,  and  N2  have  the  same  check  symbol,  then 

the  ideal  S  is  nontrivial,  for  then  C(0)  =  CCN,-^),  and  thus 

the  ideal  contains  more  than  just  the  number  zero. 

It  is  know  that  in  a  ring  of  integers  any  ideal  is  a 

principal  ideal  and  thus  contains  all  multiples  of  some 

integer  b.   The  residue  classes  are,  therefore,  residue 

classes  modulo  b.   Thus,  there  is  a  one-to-one  correspondence 

between  residue  classes  and  check  symbols.   For  every  j, 

0  <  j  <  b,  consider  C(j)  to  be  the  check  integer  for  the 

residue  class  containing  j;  that  is,  define  C(j)  =  j.   Then 
« 

i*j  =  C(i)*C(j)  =  C(i+j)  =  (i  +  2)  mod  b,  and  thus  the  checking 
operation  is  additon  mod  b. 

If  there  are  as  many  check  symbols  as  numbers,  each  number 
has  a  distinct  check  symbol,  and  the  checker  is  equivalent  to 
a  duplicate  adder.   Theorem  4.1  shows  that  separate  codes, 
defined  according  to  (4.1)  are  necessarily  residue  codes. 
Since  R„(N,xN  )  =  RR(N,)  x  R-o(N  )  we  can  conclude  that  residue 
codes  have  the  interesting  property  of  being  conserved  through 
multiplication. 

B.   MULTIRESIDUE  CODES 

An  important  generalization  of  the  ideas  explored  above  is 
found  in  the  theory  of  multiresidue  codes,  first  introduced  by 
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Dadayev.   The  mul tires idue  code  in  Z   generated  by  the  positive 
integers  m,  ,  m2  ...  m-,  each  being  a  divisor  of  m  is  the  set  of 
(k+1) -tuples  of  integers 

Nc  =  [N,  C1  (N),  C2(N)  ...  Ck(N)] 

with  N  in  Z   and  where  C . (N)  =  R  .  (N) ,  i  =  1 ,  2  . . .  k .   So 
m  1 v  J  mi  v  ' '       ' 

each  code  word  is  formed  by  one  information  integer  N  and  k 
check  integers  C . (N) .   In  this  study  we  will  assume  that  each 
of  these  integers  is  represented  in  its  radix-2  form,  as  indi- 
cated for  use  in  digital  computers .   Since  each  m.  is  a  divisor 
of  m  it  follows  that 

C(N,  +  N9)  =  R  .  (N-.  +  N?)  =  R  .  [C(N,  )  +  C  (N~)  ] 
1^1     V  mi  v  1     2J  mi  L  r  1J  l  *•  2J  J 

So  the  i    check  integer  for  N,  N2  can  be  calculated  as  the 

modulo  m.  sum  of  the  i    check  integers  for  N,  and  N~.   As 
l  °         1       2 

a  result,  modular  arithmetic  in  Z   can  be  performed  by  k+1 
independent  adders  (or  arithmetic  units),  the  first,  which 
we  will  call  the  main  processor,  performing  modulo  m 
arithmetic  on  the  information  integers,  while  the  other, 
which  we  will  call  checkers,  performing  modulo  m-  arithmetic 
on  the  corresponding  check  integer. 

C.   AN  CODES  AND  MULTIRESIDUE  CODES 

Consider   A  =  LCM  (m-p  m2  ...  m,)  where  LCM  (a,  b,  ...  j) 
denotes  the  least  common  multiple  of  a,  b,  ...  j. 
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Lemma  4.1 

For  any  N  in  Z   the  check  integers  C,(N)  ,  ...  C^(N)  in 
the  multiresidue  code  generated  by  m,  ,  nu,  .  .  .  m,  uniquely 
determine  and  are  also  uniquely  determined  by  the  residue 
RA(N). 

Proof 

N  =  KA  +  RA(N) 

but  A  =  m,  ,  nu,  ...  m-,  as  an  immediate  consequence 

Rm  (KA)  =0.   So,  Rm  (N)  =  Rm  [R  (N)  ]   =  C^N). 
i  i        i 

Now,  suppose  N,  +   N0  and  R_  (N,  )  =  R   (N0) ;  then  R   (N, -N-)  =  0 
'    rr      12      m.  ^  lJ  m.  2J  m.   1  2J 

11  l 

i  =  1,  2,  ....,  k  and  (N,-N2)  is  divisible  by  m-  for  all  i. 
But  since  A  =  LCM  (m-,  ,  m2 ,  ...  m-.  )  ,  N-,  -N?  is  also  divisible 
by  A  and  then  RA(N1)  =  RA(N2) . 

Now  suppose  that  the  result  of  some  operation  whose  correct 
result  is  N  is  in  fact 

N'  =  [N  0  F,  C1(N),  ...,  Ck(N)]  (5.2) 

because  of  a  ring  error  F  in  the  information  digit  N.   It 
follows  from  Lemma  4.1  that  the  assumed  correct  check  integers 
in  N'  suffice  to  determine  R,(N),  which  can  then  be  subtracted 
modulo  m  from  the  possibly  erroneous  information  integer  N  +  F 
in  N'  to  give 

I  =  [N  0  RA(N)]   +  F 

or,  upon  noting  that  N  0  R. (N)  is  divisible  by  A  and  thus  of 
the  form  AN,  for  some  0'  <_  N,  <  B  =  m/A, 
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I  =  ANX  ©  F  (5.3) 


Let's  now  define  for  a  mul tire si due  code,  its  associated  AN 
code  as  being  the  AN  code  with  A  =  LCD  (m,,  nu  ...  nO  •   Then, 
equation  (4.2)  proves  that  an  error  F  occurred  in  the  addition 
of  two  mul ti residue  coded  integers,  can  be  corrected  or  detected 
if  it  can  be  corrected  or  detected  in  its  associated  AN  code. 
In  addition,  the  converse  is  also  true,  as  we  see,  again  using 
Lemma  4.1,  from  the  fact  that  the  same  values  of  the  check 
integers  would  result  from  any  of  the  B  integers  N  having  the 
same  residue  RA(N)  determined  by  the  check  integers,  so  that 
the  AN,  in  (5.3)  might  have  been  any  of  the  code  points  in  the 
associated  AN-code.   As  a  consequence,  the  following  important 
and  fundamental  result  is  proved. 
Theorem  5 . 2 

If  T   and  T,  are  any  disjoint  subsets  of  Z  ,  then  a  multi- 

c      d       J  J  m' 

residue  code  can  correct  any  ring  error  F  in  T   appearing  in 
its  information  integer,  or  detect  any  ring  error  in  T, 
appearing  in  its  information  integer  (assuming  the  check 
integers  are  error-free)  if  and  only  if  the  associated  AN-code 

can  correct  all  ring  errors  in  T   and  detect  all  ring  errors  in 

°  c 

T,  in  its  code  points   Theorem  5.2  provides  the  justification 
to  the  emphasis  given  to  AN  codes,  regardless  of  the  fact 
that  separate  codes  seem  to  be  the  most  natural  choice  for 
most  practical  applications. 

The  cyclic  AN-codes  again  assume  fundamental  importance 
since  in  their  case,  m  =  2  -1  and  the  main  processor  is  then 
just  an  ordinary  n-bit  one's  complement  arithmetic  unit.   We 
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note  that  there  is  a  freedom  in  choosing  a  multiresidue  code 

from  a  given  AN-code  that  can  often  be  used  to  advantage  in 

simplifying  the  checkers.   The  only  requirement  is  that  the 

m-  be  selected  so  that  their  least  common  multiple  is  A. 

For  instance,  if  A  =  315  =  3x5x21,  we  could  select  a  uni- 

residue  code  with  m,  =  315.   We  could  also  select  a  biresidue 

code  with  m.  =  5  and  m0  =  21  or  a  biresidue  code  with  m,  =  15 
l  2  1 

=  2   -  1  and  m-,  =  63  =  2   -  1.   This  latter  choice  is  the  most 
advisable  since  the  two  checkers  could  then  be  built  as  4-bit 
and  6-bit  one's  complement  arithmetic  units,  respectively. 
This  particular  value  for  A  generates  a  cyclic  AN-code  with 
length  n  =  12,  so  that  the  main  processor  would  be  a  12-bit 
one's  complement  arithmetic  unit.   We  will  next  show  that 
there  are  useful  biresidue  codes  derived  from  cyclic  AN-codes 
that  have  one's  complement  checkers. 

D.   MULTIRESIDUE  CODES  DERIVED  FROM  CYCLIC  AN-CODES 

When  m.  =2  -1,  not  only  is  the  corresponding  checker 
simply  a  b  bit  one's  complement  arithmetic  unit  as  noted 
previously,  but  also  the  residues  modulo  b  are  easily  formed, 
i.e.,  the  check  integers  for  N  are  simple  to  calculate. 
(Throughout  this  section,  we  shall  often  use  the  fact  that 
for  any  integer  c  >  1,  c1-!  divides  c-'-l  if  and  only  if  the 
positive  integer  i  divides  the  positive  integer  j.)   For, 
suppose  m.  =  2  -1  and  the  multiresidue  code  is  derived  from 
a  cyclic  AN-code  so  that  m  =  2  -1.   Since  m-,  divides  m,  then 
b  divides  n,  so  that  the  radix- 2  form  of  any  N  in  Z   may  be 
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partitioned  into  n/b  portions  each  with  b  bits.   If  I.  is  the 

+■  \t 
integer  represented  by  the  i    lowest  portion,  then 

N  =  I1  +  2bI2  +  ...  +2-bIn/b 

and  it  follows  then  from  (3.3)  and  (3.4)  that 

R   (N)  =  R    (I,  +  I,,  +  .  .  .  +  I  /TJ 
m.       m.  v  1     2  n/b' 

l        i 

that  is,  the  check  digit  C-(N)  is  the  modulo  2  -1  sum  of  the 
integers  I,,  I?,  ...,  In/u-      Hence,  the  checker  itself  (which 
is  a  b-bit  one's  complement  arithmetic  unit)  can  form  the 
check  digit  by  adding  the  n/b  integers  represented  by  the  con- 
secutive b-bit  portions  of  the  radix-2  form  of  N  as  this 
radix-2  form  is  being  read  into  the  arithmetic  unit  of  the  main 
processor. 

We  now  go  on  to  consider  some  useful  multiresidue  codes 

derived  from  cyclic  codes  each  of  whose  m.  is  of  the  form 
7  i 

u 

2  -1  for  some  b. 

Combining  the  results  of  Theorem  5.2  and  Corollary  4.1, 
we  have  immediately  the  following: 

Corollary  5 . 1 

For  m  =  2  -1  and  any  even  n,  the  uniresidue  code  generated 

2 
by  m-,  =  2-1  =  3  can  detect  all  single  modular  errors  in  its 

information  integer. 

For  these  simple  codes,  the  checker  is  simply  a  two-bit 

one's  complement  arithmetic  unit.   If  n  is  large,  it  is 

certainly  reasonable  to  assume,  as  we  have  been  doing,  that 

the  checker  is  much  more  reliable  than  the  main  processor. 
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We  now  proceed  to  establish  a  similar  result  for  single- 
error-correction  which  is  due  to  Rao. 

Theorem  5 . 3 

For  any  two  integers  a  and  b,  a  >  1  and  b  >  1,  the  bi- 
residue  code  with  m,  =  2  -1  and  nu  =  2  -1  and  with  m  =  2  -1 
and  n  =  LCM(a,b)  can  correct  all  single  modular  errors  in  its 
information  integer. 

Proof 

By  Theorem  5.2  it  suffices   to  show  that  A  =  LCM  (m,  ,  nu) 

generates  a  cyclic  AN-code  of  length  n  =  LCM(a,b)  having 

D  •   >  3.   But  A  divides  2X-1  if  and  only  if  both  m,  =  2a-l 
mm  —  '  1 

and  nu  -  2  -1  divide  2  -1,  which  in  turn  occurs  if  and  only 
if  LCM(a,b)  divides  i.   It  follows  that  our  choice  of  n 
satisfies  n  =  e(A),  the  exponent  of  2  modulo  A.   Now,  by 

Theorem  3.3,  D  .   >  3  unless  n  =  e(A)  is  even  and  A  divides 

'   mm  —  v  J 


:n/2  +  l. 


But  if  n  is  even,  at  least  one  of  a  and  b  must  be 


even,  say  a  =  2a'.   But  a  divides  n  and  hence  a'  divides  n/2, 

a '  n/2 

which  implies  that  2    -  1  divides  2  '  u    -  1  and  further 

a '  n/2 

implies  (for  a'  >  1)  that  2    -  1  does  not  divide  2  '   +  1. 

Thus,  neither  can  nu  =  2a  -  1  =  (2a'  -  1)  (2a*  +  1)  nor  A  = 

LCM(nu  ,  nu)  divide  2n^2  +  1,  so  that  D  .   >  5  for  a'  >  1. 

v  1'  2J  '  mm  — 

The  case  where  a'  =  1,  i.e.,  where  a  =  2,  is  trivial. 

The  single- error-correcting  cyclic  AN-codes  derived  from 
the  biresidue  codes  of  Theorem  5.5  are,  of  course,  inferior, 
as  AN-codes,  to  the  perfect  codes  of  Theorem  3.4.   On  the 
other  hand,  the  form  of  the  residues  m,  and  m?  makes  these 
codes  the  practical  choice  for  implementation  as  biresidue 
codes.   In  fact,  only  uniresidue  codes  can  be  derived  from 


the  codes  of  Theorem  3.7  since  A  is  a  prime  p  and  the  checker 
would  have  to  do  arithmetic  in  GF(p)  . 

Example  5.1 

Choose  a  =  5  and  b  =  7  for  the  biresidue  code  in  Theorem 
5.3.   Then  n  =  LCM(5,  7)  =  35,  so  that  the  main  processor  is 
a  35-bit  one's  complement  arithmetic  unit.    The  two  checkers 
are  5-bit  and  7-bit  one's  complement  arithmetic  units, 
respectively . 

One  important  aspect  of  multiresidue  codes  should  not  be 

overlooked.   The  number  of  code  words  N  in  the  multiresidue 

code  is  always  given  by  m  =  AB  regardless  of  the  number  of 

code  words  B  in  the  associated  AN-code.   Particularly  for 

cyclic  AN-codes  where  m  =  2   -  1 ,  we  see  that  the  number  of 

code  words  in  the  multiresidue  code  depends  only  on  the 

length  n  of  the  cyclic  AN-code  and  not  at  all  on  its 

redundancy  log2A.   A  natural  definition  of  the  redundancy  of 

the  multiresidue  code  generated  by  m, ,  m,,  ...  m,  is  as  the 

quantity 

k  k^ 

r  =  £.  log9m.  =  log?(\(   m.)  (5.4) 

i=l      L    1  L    i=l   x 

Since  A  =  LCM(m,  ,  m7 ,  ...  MO  it  follows  that  a  multiresidue 
code  always  has  at  least  as  great  redundancy  as  its  associated 
AN-code,  i.e.,  r  >_  log?A,  and  that  the  redundancies  are  equal 
if  and  only  if  the  moduli  m.  are  pairwise  relatively  prime. 
We  note  also  that  r,  as  given  by  (5.4),  is  an  approximate 
measure  of  the  number  of  bit  positions  required  for  the  radix-2 
forms  of  the  check  integers  in  a  multiresidue  code. 


A  final  comment  on  Theorem  5.3  should  also  be  made.   Suppose 
a  divides  b  so  that  n  =  b  and  hence  A  =  m  =  2   -  1.   The  asso- 
ciated cyclic  AN-code  has  only  B  =  1  code  point  and  hence 

D  .   =  °°   so  that  it  can  correct  all  errors  in  its  code  points, 
mm    '  r 

By  Theorem  5.2,  the  multiresidue  code  can  correct  all  errors 
in  its  information  integer  if  the  check  integers  are  error-free. 
This  is  not  as  surprising  as  it  may  seem  when  one  observes  that 
nu  =  m,  so  that  the  second  checker  is  in  fact  a  duplicate  of 
the  main  processor!   What  this  does  point  out  is  that  our 
working  assumption  that  the  checkers  are  much  more  reliable 
than  the  main  processor  is  certainly  unacceptable  when  some  m- 
coincides  with  m. 


E.   SYNDROMES  IN  iMULTIRESIDUE  CODES 

Suppose  that 

V  =  (I,  J1$    J2,  .  ..,  Jk)  (5.5) 

is  a  (k+1) -tuple  with  I  in  2   and  J.  in  Z    that  is  a  possibly 

m      l     m.  r      / 

i 

erroneous  code  word  in  a  multiresidue  code.   We  define  the 
syndrome  S (V)  of  V  in  the  multiresidue  code  to  be  the  k-tuple 

SCV)  -  i\     Cl-Ji).  .-.,  Rmfc  d-Jk)]  (5.6) 


Notice  that  if  V  is  an  actual  code  word  N,  then  J.  =  Rm   (I) 
so  that  from  (3.2)  we  have 


l     m-. 


S(V)  =  [0,  ...,  0]  (5.7) 

and  conversely,  (5.7)  holds  only  if  V  is  a  code  word. 
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Notice  that  that  conclusion  does  not  require  our  hypothesis 
that  error  can  occur  only  in  the  information  integer. 

Now,  if  errors  can  occur  only  in  the  information  integer 
so  that  V  has  the  form  Nf  given  in  (5.2),  we  see  that  again 
with  the  aid  of  (3.2)  that  (5.6)  gives 

S(N')  =  [R    (F),  R    (F),  ...,  R    (F)]         (5.8) 
ml       m2  k 

But  (5.8)  together  with  Lemma  5.1  shows  that  S(N')  uniquely 
determine,  and  in  turn  is  uniquely  determined  by,  R.(F),  which, 
we  recall  from  (5.5),  is  the  ordinary  syndrome  S(A  +  F)  for 
the  result  A  +  F  in  the  associated  AN-code.   We  have  proved 
the  following: 

Lemma  5 . 2 

The  multiresidue  code  syndrome  S(N')  for  a  result  N'  = 

4 

[N  +  F,  C-,  (N)  ,  ...,  CifN)  ]  uniquely  determines,  and  in  turn 
is  uniquely  determined  by  the  syndrome  S (A  +  F)  of  the 
associated  AN-code. 

Now,  combining  the  results  of  Theorem  5.1,  Lemma  5.2, 
and  Theorem  3.3,  we  obtain  the  following: 

Theorem  5 . 4 

Let  T   and  Tj  be  any  disjoint  subsets  of  Z  .   Then,  a 
c      d      '     J  m       ' 

multiresidue  code  can  correct  all  ring  errors  in  T   in  its 

to  c 

information  integer,  and  can  detect  all  ring  errors  in  T,  in 
its  information  integer  (assuming  the  check  integers  are 

error-free),  if  and  only  if  there  is  no  error  F,  in  T   that 

*  ;  1     c 

gives  the  same  syndrome  (5.8)  as  some  other  error  F?  in  either 
T   or  T,. 


85 


Note  that,  according  to  (5.5),  the  checkers  themselves 
can  be  used  to  calculate  the  syndrome  S(V)  =  S(N'),  since 


CI-J±D   =  Rm     U)  ©  Ji  for  Jkz  2 


m. 


m. 


(5.9) 


This  syndrome  may  then  be  used  in  an  error  correction  and 
detection  procedure  for  multiresidue  codes  entirely  analogous 
to  that  suggested  for  AN-codes. 
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VI.   IMPLEMENTATION  OF  ARITHMETIC  CODES 

We  will  in  this  chapter  address  briefly  the  question  of 
implementation  of  arithmetic  codes.   The  real  problem  in 
implementation  is  the  decoder,  that  is,  the  device  that 
checks  the  results  for  correctness,  and  that  does  the  actual 
correction  if  a  correctable  error  is  found  to  have  occurred. 

It  is  at  the  point  interesting  to  note  that  the  design 

of  a  decoder  will  depend  upon  the  user  choice  of  the  sets 

T   and  T,,  respectively  the  set  of  correctable  and  detectable 

errors.   It  is  to  be  noticed  that  Theorems3.2  and  5.6  do  not 

determine  5  and  s . 

For  instance,  for  a  code  with  minimum  distance  D    =6, 

mm 

decoders  can  be  specified  that  will: 

a.  Correct  all  single  or  double  errors  and  detect 
all  triple  errors  (t  =  2,  s  =  1) . 

b.  Correct  all  single  errors  and  detect  all  double, 
triple  or  quadruple  errors  (t  =  1,  s  =  3) ,  or  yet 

c.  Detect  all  errors  with  weight  less  than  6  (t  =  0, 

s  =  5) .   All  these  choices  give  2t  +  s  <D 

6  mm 

Figure  6.1  a,  b  and  c  illustrates  respectively  the  decoders 
characterized  in  a,  b  and  c  above. 
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(a) 


(b) 


Fig.  6.1.   Decoding  Rules  for  D  •   =6 
to  °  mm 

Any  actual  result  in  sphere  S.  is  translated  into 
code  point  i.   Points  not  included  in  any  S-  are 
detected  as  errors . 


A.   DECODER  FOR  AN  AN- CODE 

The  decoding  algorithms  for  an  AN-code  has  been  briefly 
outlined  in  Chapter  IV,  and  is  next  discussed  in  further 
detail.   If  the  actual  —  possibly  erroneous  —  result  of  an 
operation  is  Y,  the  first  step  in  the  decodif icat ion  process 
if  to  calculate  the  syndrome  S(Y).   A  syndrome  S(Y)  =  0  is 
interpreted  as  a  correct  result. 

If  a  nonzero  syndrome  results,  the  next  step  is  to  look 
up  in  a  table  the  correction  C  =  -  F,  corresponding  to  S(Y). 
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Theorem  3.3  guarantees  that  there  is  a  one  to  one  correspondence 
between  the  syndrome  of  any  correctable  error  and  the  error 
itself.   The  correct  result  is  therefore 

I  =  Y  ©  C 

Figure  6.2  presents  a  flow  chart  of  the  above  described  algo- 
rithm. Notice  that  steps  4,  5  and  7  are  not  required  if  only 
detection  of  errors  is  desired. 

We  see  immediately  that  only  two  of  the  steps  in  the 
algorithm  involve  some  difficulty. 

a.  The  determination  of  the  syndrome  S(Y)  =  R,(Y), 
since  this  calculation  requires  the  determination  of  the 
remainder  of  the  division  of  Y  by  A,  and  it  does  not  seem 
very  smart  to  check  an  addition  with  an  algorithm  that 
requires  a  more  involved  operation  such  as  division.   This 
problem  will  be  addressed  in  Section  C. 

b.  The  lock  up  operation  to  find  the  correction,  given 
the  syndrome.   This  operation,  even  though  conceptually  trivial 
may  require  a  very  extensive  table,  when  large  or  even  moderate 
distance  codes  are  used  and  if  a  decoder  with  large  error 
correcting  capability  is  desired.   Notice  however,  that  this 
step  is  unnecessary  for  decoders  that  only  make  error  detection, 
and  further,  that  the  size  of  the  table  is  considerably  reduced 
if  only  a  small  set  of  errors  is  to  be  corrected,  as  in  the  case 
of  single  error  correction. 

The  look  up  operation  also  may  result  in  considerable  delays, 
but  use  of  associative  memories  may  be  a  way  of  eliminating 
such  excessive  delays. 
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CALCULATE 
S(Y)  =  RA(Y) 


LOOK  UP 
C  = -  F(Y) 


T 


Y  IS  AN 

ERRONEOUS  RESUL 


I  =  Y 


Fig.  6.2.   Flow  chart  for  decoding  algorithm  for  AN-codes 
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B.   DECODER  FOR  RESIDUE  CODES 

The  algorithm  that  decodes  a  multi residue  code  is  very 
similar  to  that  described  in  Section  A. 

If  N'  is  a  possibly  erroneous  result  of  an  addition,  then 
the  syndrome  S(N')  is,  according  to  (5.8) 

S(N')  ■  [Rj,  CF),  RM  (F)  ...  R   (F)] 

_L  u  K 

As  pointed  out  in  (5.9)  the  syndrome  can  be  evaluated  by  the 

checkers  themselves,  provided  R„  (I)  is  known.   So,   again, 

i 
the  determination  of  S(N')  implies  the  determination  of  the 

remainder  of  a  division  of  I  by  M- .   Lemma  5.2  assures  the 

possibility  of  constructing  a  lock-up  table  that  translates 

S(N')  into  the  correction  to  be  applied  to  N'  to  produce  the 

correct  result. 


C.   DETERMINATION  OF  RM(N) 


Let's  now  consider  the  problem  of  determining  the  residue 
of  an  arbitrary  integer  N,  represented  in  its  radix-2  form, 
modulo  another  integer  M. 

As  we  have  shown  previously,  this  is  an  essential  step  in 
any  algorithm  intended  to  decode  an  arithmetic  code. 

We  will  show  that  this  determination  can  be  accomplished 
by  means  of  a  modulo  M  multiply  by  2  shift  register,  with 
block  diagram  is  represented  in  Fig.  6.3. 

Fig.  6.3  gives  a  false  impression  about  how  complicated 
the  circuit  is,  because  it  attempts  to  make  a  general,  easy 

to  understand  schematic  representation  of  the  device. 
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Actually  BLOCK  1  is  just  a  (n+1)  input,  one  output 
combinational  logic  network,  and  BLOCK  2  is  just  a  few 
pieces  of  wire,  correcting  the  output  of  BLOCK  1  (OUT  1)  to 
the  proper  adder  inputs  to  form  the  negative  of  M,  modulo 
2n,  in  such  a  way  that  the  adder  actually  subtracts  M  from 
the  content  of  the  register  whenever  OUT  1=1.   The  opera- 
tion of  the  device  is  self  explanatory. 

N  is  shifted  into  the  register,  most  significant  binary 
digit  first.   Whenever  the  contents  of  the  register  is 
greater  than  M-l/2,  or  is  equal  to  M-l/2  but  the  input  is  1, 
the  content  of  the  register  after  next  shift  would  be  greater 
than  M,  but  less  than  2M.   If  M  is  subtracted  at  shift  time, 
then  the  content  of  the  register  will  be  conserved  less  than 
M,  and  R^CN)  will  be  stored  in  the  register  after  N  is 
completely  shifted  in. 

An  example  of  such  a  circuit  is  given  in  Figure  6.4  which 
represents  a  modulo  5,  multiply  by  2  shift  register,  that 
will  calculate  Rr (N)  ,  regardless  the  length  of  the  radix-2  for 
of  N.   To  illustrate  the  operation  of  the  circuit  in  Figure 
6.4,  let's  take  N  =  10110  =  221Q.   Table  IV  gives  the 
successive  states  of  the  register  as  N  is  shifted  in. 


93 


<  INPUT 


BLOCK  2 


Fig .  6.4 


Modulo  5  multiply  by  2  shift  register 


TABLE  IV 


Clock  Pulse 

Register 

Input 

0 

000 

1 

1 

001 

0 

2 

010 

1 

5 

000 

1 

4 

001 

0 

5 

010 

X 

■R ,(22)  =  2 

Operation  of  Modulo  5  Divided  by  2  Shift  Register 
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VII.   CONCLUSION 

This  thesis  constitutes  a  tutorial  study  on  arithmetic 
codes . 

It  seems  appropriate  at  this  point  to  emphasize  the  fact 
that  the  problem  of  designing  an  arithmetic  code  is  essentially 
that  of  finding  a  generator  A  which  generates  an  AN-code  with 
the  desired  error  correcting  and  detecting  capabilities  for 
addition  in  the  ring  of  integers  modulo  B.   This  is  evident 
for  AN-codes.   For  residue  codes  it  translates  into  finding 
an  integer  A  =  LCM  (m,  ,  m? ,  ...,  m-.)  which  generates  an  AN- 
code  which  is  capable  of  correcting  all  errors  in  T  ,  and  of 
detecting  all  errors  in  T , ,  respectively  the  sets  of 
correctable  and  detectable  errors  in  the  information  integers 
of  the  residue  code  defined  by  m, ,  m? ,  . . . ,  m,  and  the  number 
of  code  points. 

The  theory  discussed  in  the  previous  chapters  provides 

some  guidance  and  some  tools  to  solve  that  problem.   We  have 

mentioned  in  Chapter  4,  that  perfect,  single  error  correcting 

AN-codes,  analogous  to  Hamming  parity  check  error  correcting 

codes  are  known.   Also,  large  distance  cyclic  AN-codes  have 

been  discovered  by  Mandelbaum  and  Barrows.   Unfortunately, 

moderate  distance,  systematically  constructed  AN-codes  are 

not  known.   A  proof  of  a  BCH-like  bound  for  AN-codes  such  as 

the  Hartman  conjecture  outlined  in  Chapter  IV  would  constitute 

a  major  theoretical  contribution  to  the  field  of  arithmetic 

codes . 
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On  the  practical  side  of  the  matter  we  recognize  that 
extensive  circuitry  is  required  to  decode  arithmetic  codes. 
The  search  for  more  efficient  algorithms,  applicable  to 
particular  classes  of  codes,  that  could  be  easily  implemented 
in  hardware  is  an  attractive  and  promising  area  for  future 
research.   The  analogies  between  cyclic  AN-codes  and  cyclic 
parity  check  error  correcting  codes  may  suggest  the  possibility 
of  decoding  with  shift  registers . 

We  have  through  this  paper  made  the  assumption  of  perfect 
decoding,  since  our  main  concern  was  the  structure  of  arith- 
metic codes.   In  real  life,  this  assumption  is  quite  unrealis- 
tic.  The  evaluation  of  the  improvement  in  reliability  that 
can  be  achieved  by  using  arithmetic  codes  under  imperfect 
decoding  is  also  an  interesting  subject  for  additional  effort. 

Finally,  it  is  appropriate  to  mention  that  this  thesis  is 
not  intended  to  present  original  contributions.   The  material 
discussed  here  has  been  discussed  by  many  authors,  such  as 
Peterson,  Massey,  Garcia,  Hartman,  Avizienis  and  many  others. 
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